Edit: /opt/dedrads/__pycache__/alp.cpython-313.pyc (18817B)
}j@ Z S r SSKrSSKrSSKrSSKrSSKrSSKJr SSKJr SSK J
r
SSK J r
SSKrSSKJrJrJr SSKJrJr S rS
rS rS r\R4 " 5 S
S- rSr \R: " \ 5 r S r S r!S r"S S jr#S r$S r%S r&S r'S r(S r)S r*S r+\ S :X a \+" 5 gg) z3Apache Log Parser - Parse Apache domain access logs N)ArgumentParser)time) defaultdict)node)resolver reversename exception)
setup_loggingcolorzDaniel Kzdanielk@inmotionhosting.comz1.0.2z
2016-09-16apache_domlogsz/{0!s}/2 c [ R " 5 nSUl SUl [ R
" U 5 nUR
US5 n[ US 5 $ ! [ R a g[ R a [ R SU 5 g[ R a [ R SU 5 g[ R a [ R S U 5 g
f = f) zReturn PTR for IP addressg ?PTRr zNo Record Foundz Query Timed out looking for %szQuery Timed OutzNo nameservers found for %szNo nameservers foundzNo answer for %sz No Answer)r Resolverlifetimetimeoutr from_addressquerystrNXDOMAINr TimeoutLOGGERdebug
NoNameserversNoAnswer)ip_addr
myresolver
question_nameanswerss /opt/dedrads/alp.py
ptr_lookupr! " s &&(
!
#009
""=%871: ! ! 5w? ! ! & 2G<% '1s$ AA C31)C3 )C3)C32C3c # # U S:X a. [ R S5 [ R Sh vN gU n[ R SU 5 [ R
R
U5 ( a [ USS9 n U Sh vN SSS5 gg Na N! [ a [ R SU5 N0f = f! , ( d f g= f7f)Process log lines-zProcessing from STDIN.NzProcess file %szutf-8)encodingzError reading file %s)
r infosysstdinospathexistsopenOSErrorerror)sourcefilename file_handles r domlog_linesr2 : s } ,-99 %v.
77>>( # #h1[D *** 21 $ + DLL!8(CD 21sX /CBA C=B=?BBB CB B:7B=9B::B==
C Cc f ^ 0 nSn[ T U 4S jSS9 H nUS- nT U X$' X1: d M Us $ U$ )z/Trim dictionary to top entries ordered by valuer c > TU $ N )x
dictionarys r
trim_dict..R s A Tkeyreverse )sorted)r8 entries trimmed_dictcountitems ` r trim_dictrE K sN L
Ez'>M ' - N r; c Z [ [ 5 [ S 5 [ [ 5 [ [ 5 [ [ 5 SS.n[ R " S5 n[ U 5 GHD nUS S- US' UR U5 nUGb
US UR
S5 S- US UR
S5 ' S R UR
S5 UR
S
5 5 nUS U S- US U' US UR
S
5 S- US UR
S
5 ' US UR
S5 S- US UR
S5 ' UR
S5 nUR
S5 n US U U S- US U U ' GM. [ R SU5 GMG [ US U5 US ' [ US U5 US' [ US U5 US ' U( a< [ [ 5 n
US H n [ U 5 n U S SU 3n
US U X' M" XS' U$ )r# c [ [ 5 $ r5 )r intr6 r; r r9 parse_domlogs..` s K,(?P[0-9.]+|[a-fA-F0-9:]+)(,\s*[0-9.]+|[a-fA-F0-9:]+)*)\s+(?P\S+)\s+(?P\S+)\s+\[(?P[0-9]+/[a-zA-Z]+/[0-9]+):(?P(?P[0-9]+):[0-9]+:[0-9]+ [0-9-+]+)\]\s+"(?P(?P[A-Z]+)\s+(?P\S+)) [^"]*"\s+(?P[0-9]+|-)\s+(?P[0-9]+|-)\s+"(?P[^"]*)"\s+"(?P.*)"$rO r? rJ statusz {: <4} {}requestrL rN iprM useragentdatehourrK zMissed log line: %sz <15 top_ips_with_ptr) r rH recompiler2 searchgroupformatr warningrE r! )r/ numlinesadd_ptrresults
rx_loglineline
match_loglinerQ rT rU ip_ptrr
ptr_record ip_with_ptrs r
parse_domlogsrg [ sw $C(#$<= $"3' s#
G
J V$ &{ 3a 7 "))$/
$'
(;(;H(EFJ
N #M$7$7$A B "(( ##H-}/B/B9/MG ,3:+>w+G!+KGJ ( "=#6#6t#<=A
I } 2 24 8 9
&}':':;'GH1L
M "=#6#6{#C D !&&v.D &&v.D'-d3a7
N #D )$ /
NN0$ 7/ %2 $GJ$7BGJ &w}'=x HGM"79#5x@GI S! y)G#G,J $TN!J<8K"))"4W"=F *
'-"# Nr; c U c [ R S5 Sn O[ R SU 5 / n[ R " [ R U 5 5 H nSU; d M SU; d M SU; a M [ R R [ R U 5 U5 n[ R R U5 ( d Mt UR U5 M U$ )zCArray of domlogs for cpuser. If cpuser is None, return all domlogs.z Choosing domlog for all users.zChoosing domlog for %s_logz-ssl
ftpxferlog)
r r& r) listdirUSER_DOMLOG_DIRr\ r* joinisfileappend)cpuser logfile_listr0 logfiles r
logs_for_userrt s ~ 34 ,f5LJJ 5 5f => ( "x)?x'ggll?#9#9&#A8LGww~~g&& ##G,
? r; c / n[ U 5 n[ U5 S:X a [ R SU 5 g[ U5 S:X a [ R SXS 5 US $ U HD n[
R R U5 [ 5 S-
: d M3 UR U5 MF [ U5 S:X a [ R SXS 5 US $ [ U5 S:X a [ R SU 5 OUnSnSnU HI n[
R R U5 U: d M( [
R R U5 nUnMK U$ ) z
Determine log file to use for a cPanel user.
This is done by first using any unique file, then using any
unique recently updated file, and then preferring size for
the remaining files.
If cpuser is None, search for all logs.
r z$Could not find valid log file for %sNr? z Only one log file for %s: %siQ z#Only one recent log file for %s: %szNo recent logs for %s) rt lenr r] r r) r* getmtimer rp getsize)rq recentlog_listrr rs largestdomlogs r choose_logfiler| s+ N (L
<A =vF
<A 3V!_MA
77 G $ 7 ! !' *
>a 16!;L
a
>a ,f5% G
F
77??7 #g -ggoog.G F
Mr; c SnSnU SX-
n [ U 5 U- nSR S [ X-
5 5 5 n[ [ R
" UR
U U5 5 5 g)zPrint pretty headerz~~ {0!s} ~~{1} N c 3 & # U H nS v M g7f)~Nr6 ).0is r print_title.. s ?$>qs$>s )rv rn rangeprintr greenr\ )titlewidth
header_formatbase_header_size head_lengthlong_bars r print_titler st %M
,E, -Ee* //Kww?E%*=$>??H
r; c ^ [ X5 Sn[ TU4S jSS9 H& nUS- n[ TU S SU 3SU 5 XB:X d M& g g) z;Print pretty data in a tall format, with one entry per liner c > TU $ r5 r6 )r7 arrays r r9 print_tall.. s E!Hr; Tr< r? z 6z N)r r@ r )r r r^ r
line_countrD s ` r
print_tallr sZ Ju"4dC !^
tR dV,Ve45 ! Dr; c [ X5 SnSnU HO nU SX S3nU[ U5 - U: a US- n[ 5 SnXB:X a gU[ U5 - n[ USS9 MQ [ 5 g)z>Print pretty data in a wide format, with many entries per liner : z r? NrV )end)r rv r )r r r^ r r
current_widthrD next_items r
print_wider s JMfBu{m2. 3y> )U 2#a J G M%%I6
iS!
Gr; c [ [ S9n U R SSSSS9 U R SSSS S9 U R 5 nUR S
S SS S9 UR S
SSSS9 U R SSSSS9 U R S5 nUR SSS[
SSS9 UR SSS[
S S S9 UR S S SS S9 U R S!5 nUR 5 nUR S"S#S$S%S&S'S(9 UR S)S*S$S%S+S,S(9 UR S-S$[ / S.QS/S09 UR S1S2S[ S3S4S9 U R S5S6[ S7S8S99 U R 5 nUR ( a; [ S:[ 35 [ S;[ S<35 [ R " S=5 UR c [ R nO([# [ UR R% 5 5 nUR& S3:X a [) S>U[ R* S?9 O[) UR& US@S?9 UR, ( a S@nOSAn[/ UR0 5 S=:X a0 [2 R5 SB5 UR0 R7 SC5 UR0 UUR8 UR: UR< UR> UR@ 4$ )Dz
Parse command line arguments
) descriptionz-az--all
store_truez]Search all users. Do not limit search to single user. Overrides any usernames or paths given.)actionhelpz-mz --multilogsz7Return results for all log files, rather than just one.z-pz
--with-ptrz-Get PTR records for IPs. This is the default.z-Pz--no-ptrz*Do not resolve PTRs for IPs. Overrides -p.z-Vz --versionz#Print version information and exit.zOutput optionsz-nz
--numlinesstore
z>Number of lines to display in each section. The default is 10.)r typedefaultr z-wz--widthn z2Width of output in characters. The default is 110.z-jz--jsonz Output data as JSON instead.zError logging optionsz-vz --verboseloglevel store_constr zUse verbose logging.)destr constr z-qz--quietcriticalzLog only critical errorsz
--loglevel)r. r& r r] r zBSpecify the verbosity of logging output. The default is 'warning'.)r r choicesr z-oz--outputr z%Output logging to the specified file.sourcesz
(USER|LOG)*zEither a cPanel user or an Apache domain log file. '-' will be handled as STDIN. If none are given, then the script will attempt to gather data from the STDIN.)metavarr nargsr zApache Log Parser version zLast modified on ri r z/var/log/messages)r* r print_outFTzNo sources. Using STDIN.r$ )!r __doc__ add_argument add_mutually_exclusive_groupadd_argument_grouprH r
parse_argsversionr __version____date__r' exitr loggingWARNINGgetattrupperoutputr
stderrno_ptrrv r r r& rp r^ r jsonall multilogs)parser ptr_group output_grouplogging_parser_group
logging_groupargs
logging_levelshow_ptrs r r r s=
0F
6
F 335I
<
9
2 ,,-=>L
O
A
h|2P "445LM(EEGM
#
'
A
(
%%
4
&
#
D ||
*;-89
!(1-. }}
)<)<)>?
{{b$"jj
4;; %P {{
4<<A ./ C
r; c U H u p4US S: a [ U S35 M [ [ R " SU S35 S- 5 US H n[ SU S3US U UU5 M [ S US
X5 [ S US X5 [ S
US X5 US b [ SUS X5 O[ SUS X5 [ S5 M g)z Print out results to terminalrO r? z
is empty.z Results for :rK z
Hourly hits ()zHTTP response codesrJ z Top RequestsrL zTop user agentsrM rW NzTop IPs with PTRszTop IPsrN
)r r yellowr r )r` r^ r r/ resultdays r
print_resultsr s " + " VHJ' (
ell\&34s:;.)C uA&~&s+
* !6.#98
>6*#5xG$f]&;XM $ % 1 #V,>%?
y&"3X E
d 3 "r; c [ 5 u n nnnnnn[ S S 5 5 ( a [ nOSn/ nU( a U( aJ [ R S5 [ S5 SU H! n [
XU5 n
UR X45 M# GO[ S5 n [ R SU 5 [
XU5 n
UR X45 GOU GH n U S:X a7 [ R SU 5 [
XU5 n
UR SU
45 MA [ R R U 5 ( a6 [ R S U 5 [
XU5 n
UR X45 M [ R R S
U < 35 ( a U( aL [ R S U 5 [ U 5 SU H! n [
XU5 n
UR X45 M# GM [ U 5 n [ R SU 5 [
XU5 n
UR X45 GMX [ R S U 5 [ R " S
5 GM U( a! [ [ R" " USSSS95 g[% XU5 g)zMain function for scriptc 3 : # U H o[ 5 ; v M g 7fr5 )hostname)r shared_types r r main.. s
N8M(* $8Ms )bizhubresNzSource is all log files.zSource is user file: %sr$ zSource is STDIN: %sSTDINzSource is file: %sz/var/cpanel/users/z Source is all files for : %sz$Unable to determine log file for: %s255T ),r ) sort_keysindent
separators)r anyMAX_LOGS_SHAREDr r& rt rg rp r| r) r* ro r] r' r r r dumpsr ) r r r^ r show_json all_usersr log_limitr` r{
sections_dictr/ s r mainr s
N8M
NNN#
G KK2 3'-jy9 -f I
67 : $D)F KK16 : )&H EM NNF2 3 F} 16: -f I
78 '' 0&9 -f I
67 "4VJ ?@@ KK >G"/"7
"C(5 "h)
'>? #D ,F 3FKK 96B$1&H$MMNNF#:; EvN1 4
JJ4k
g/r; __main__)r F),r r) r' r rX r argparser r collectionsr platformr r envinfodnsr r r radsr
r __maintainer__ __email__r r get_datarm r getLogger__name__r r! r2 rE rg rt r| r r r r r r r6 r; r r s 9
# # % 0 0 % )
""$%56B 8 $0D"
CL*.b, (eP >G0T zF r;