a Ó#d<ã@s*ddlmZmZmZmZmZmZddlmZddl m Z ddl m Z ddl mZddlmZmZmZddlZddl Z ddlZddlZddlZddlZddlZddlZddlmZdd l Tddl!Z!ee"ƒZ#d e#j$d <e ƒZ%d d „Z&dd„Z'dd„Z(dHdd„Z)dd„Z*dIdd„Z+e#j,ddgddd„ƒZ-e#j,ddgddd „ƒZ.e# ,d!¡d"d#„ƒZ/e#j,d$dgdd%d&„ƒZ0e# ,d'¡d(d)„ƒZ1d*d+gZ2e# ,d,¡d-d.„ƒZ3e# ,d/¡d0d1„ƒZ4e# ,d2¡d3d4„ƒZ5d5d6„Z6d7d8„Z7e# ,d9¡d:d;„ƒZ8e# ,d<¡d=d>„ƒZ9e# ,d?¡d@dA„ƒZ:e# ,dB¡dCdD„ƒZ;e"dEkr&e#j&óz subnet_crush..cSsg|]}t |d¡‘qSr)rZ IPv6Networkrrrrr'rú"z","z", )rZ ip_networkÚstripÚversionÚappendÚ ValueErrorZcollapse_addressesZwith_prefixlen) Ú descriptionZ input_listZsubnets6Zsubnets4Z to_returnÚnetÚnZipv4sZipv6sZipv4Zipv6rrrÚ subnet_crushs&   r%cCsf|sdSzBt|ƒ}|dkr(d|dWS|dkr>d|dWSd|WSWnty`|YS0dS)Nri@Bz%d Tièz%d Gz%d M)Úintr!)ÚvaluerrrÚ pretty_speed3s r(cCsR|jj|j|jd ¡}|s6|jj|jd d¡ ¡}|sN|j ¡ d¡ ¡}|S)N)ÚstatusÚid)r)r*)Z ixlan_setÚfilterr)r*ÚfirstZorder_byÚall)ÚixÚixlanrrrÚget_primary_ixlanAs r0TcCsž|r"t tj|¡}t|ƒj ¡}nt tj|¡}|j ¡}i}|D]F}|rR|j}n|j j }||vrz||d|j 7<qBd|j i||<qB|t |  ¡ƒ|jfS)NÚspeed)ÚpdbÚgetrÚInternetExchanger0Z netixlan_setr-ÚNetworkZnet_idr/r*r1ÚlistÚkeysÚname)r*r.ÚfieldÚmembersZnetworksÚmemberZ cmp_fieldrrrÚ get_membersKs r<cCs ||vrt||dƒSdSdS)Nr1r)r()Z member_idr.rrrÚ member_on`sr=cCs(|rt tj|¡jSt tj|¡jSdS)N)r2r3rr5r8r4)r*r.rrrÚ id_to_namefsr>z/pcap-upÚPOST)Úmethodsc Cszd}dtjvrd}tjd}|jdkr*d}|rjtj tjdd¡}tj tjdd¡}ttj d ƒ}|  |¡d}zÂt |dd Š}d }d }t   |¡} | D]b} d}ztt | d ¡ƒ}|d 7}Wn|d 7}YqšYn0t||dd|d krš||kršqþqšWdƒn1s0Ytddd|jdddWStyh} zdt| ƒ}WYd} ~ n d} ~ 00tddd|dS)NzUnknown failure has happenedÚfilez No file partrzNo selected filerz upload.csvz filtered.pcapÚlimit)ÚnewlinerZpduéT)r z output.htmlzLast PDUzBringing you the latest in PDUs)Údump)ÚtitleÚsubtitlerEz-Your honour, my client pleads oopsie daisy - )rÚfilesÚfilenameÚosÚpathÚjoinÚappÚconfigr&ÚformÚsaveÚopenÚcsvZ DictReaderZEtherÚbytesÚfromhexZwrpcaprZshowÚ ExceptionÚstr) ZfailurerAZsrc_fileZtmp_filerBÚpacketZcsvfileZparsed_counterZfailed_counterZ pdu_readerÚrowÚerrrÚpcap_upls>       6"rZz /ip-lookupc CsÒtjd}t d¡}g}d}td|tƒD]Ž}| |¡}i}|durdd|d<d|d<d|d<d|d <n0|d |d<|d |d<|d |d<|d |d <|d7}||d<||d<| |¡q(tdddgd¢|dddS)NÚinputzipnetdb_prefix_latest.mmdbrz/(?:(?:25[0-5]|(?:2[0-4]|1\d|[1-9]|)\d)\.?\b){4}ZUNKNOWNú AS EntityÚASÚOriginÚPrefixZ as_entityÚasZprefix_originsÚprefixrDÚIPÚRankú generic.htmlz IP LookupzPowered by Leakage)r_rbrcr\r]r^)rFrGr7ÚrowsZcanvas_count_1Zcanvas_count_2) rrOÚ maxminddbZ open_databaseÚ re_findallÚ re_multiliner3r r)r'ÚreaderreZrankÚipZip_dataÚdatarrrÚip_lookup_htmlŸs*         rlz/eyeballc Cs>g}g}i}i}i}tddƒ}t |¡}Wdƒn1s>0Ytddƒ}t |¡}Wdƒn1sr0Ytddƒ}t |¡}Wdƒn1s¦0Yt| ¡ƒt| ¡t| ¡ƒƒ}|D]L}i}| t|ƒ¡}| t|ƒ¡} zà|||d<||d<| dur@d|d<d|d <d|d <d|d <n8|  d ¡|d<|  d ¡|d <|  d¡|d <|  d¡|d <|dur¤d|d<d|d<d|d<d|d<n8| d ¡|d<| d ¡|d<| d¡|d<| d¡|d<Wn<d|d<d|d<d|d<d|d <d|d <d|d <Yn0| |¡qØt dddgd¢|dS)Nzau-rankings.jsonÚrzus-rankings.jsonzasn-lookup.jsonÚNameÚASNú-úAU Eyeball Samplesú AU Peer Countú AU CONE SizeúAU Domains HostedÚesZpcÚcsZdhúUS Eyeball Samplesú US Peer Countú US CONE SizeúUS Domains HostedzERROR OCCURREDrdz Ranking DatazPowered by Memes) rnrorqrrrsrtrwrxryrz)rFrGr7re) rQÚjsonÚloadr6r7Úsetr3rVr r) rer7Zau_rankings_jsonZus_rankings_jsonZasn_lookup_jsonZJSONÚkeyrkÚusZaurrrÚ eyeball_html¾s\ ( ( ($       r€z /subnet-crushcCs6tjd}tjd ¡}t||ƒ}tdd|t|ƒdS)Nr"Ú addresseszsubnet-crush.htmlzSubnet Crusher)rFÚcrushedre)rrOÚ splitlinesr%rÚlen)r"rr‚rrrÚsubnet_crush_displayûs  r…z/ix/nbn/cCshtd|ƒsdStƒ}|j dddœ¡| d|›d¡}|jsBdS| ¡}tdd i|d ¥|d ¥d S) Nz ^LOC\d{12}$)rizNMozilla/5.0 (Windows NT 10.0; Win64; x64; rv:81.0) Gecko/20100101 Firefox/81.0z*https://www.nbnco.com.au/learn/rollout-map)z User-AgentZRefererz.https://places.nbnco.net.au/places/v2/details/z?source=website_rollout_mapznbn.htmlZNBNZ servingAreaZ addressDetail)rFÚloc_data)Ú re_searchr ÚheadersÚupdater3Úokr{r)Zloc_idZ nbn_sessionZ loc_responser†rrrÚnbn_display_htmls þr‹r#r.zK/ix/cmp4/////c CsŽ|dkrpt tj¡j|d ¡j}t tj¡j|d ¡j}t tj¡j|d ¡j}t tj¡j|d ¡j}t||dkƒ}t||dkƒ}t||dkƒ}t||dkƒ}t|d|d|d|dƒ} t|dƒt|dƒ@t|dƒ@t|dƒ@} g} t| ƒD]V} |   | t | |dkƒ| | vt | |dƒt | |dƒt | |dƒt | |dƒdœ¡qt dd|d|d|d|dg| t |dS) NrD©Úasnr)r*r8r-ÚaÚbÚcÚdzix4.htmlÚHomeé©rFÚ out_namesÚout_allÚtype©r2r-rr5r+r,r*r<r}r r>r=rÚTYPES) Úix_id_aÚix_id_bÚix_id_cZix_id_dÚmodeÚix_aÚix_bÚix_cZix_dÚix_allÚ ix_on_allr–r*rrrÚfactors4_display_raw_htmls$0 Tr£z=/ix/cmp3////c Cs>|dkrVt tj¡j|d ¡j}t tj¡j|d ¡j}t tj¡j|d ¡j}t||dkƒ}t||dkƒ}t||dkƒ}t|d|d|dƒ}t|dƒt|dƒ@t|dƒ@}g} t|ƒD]H} |   | t | |dkƒ| |vt | |dƒt | |dƒt | |dƒdœ¡qÌt dd|d|d|dg| t |dS) NrDrŒr)r*r8r-rŽrrzix3.htmlr’r“r”r˜) ršr›rœrržrŸr r¡r¢r–r*rrrÚfactors3_display_raw_html/s$ Fr¤z//ix/cmp2///c Csð|dkr//c CsŒt|ƒ}t|ƒ}t|ƒ}g}t| ¡ƒD]L}t|ƒ}z2| ||d|d|||||||dœ¡Wq(Yq(0q(tdd|||g|dS)NrDr)r*Zcountryrr8rŽrrz atlas3.htmlr’)rFr•r–)r¬Úsortedr7r­r r) ršr›rœržrŸr r–r*Z probe_detailrrrÚatlas_display_raw_htmlls2r¯z/ix/mapcCsZtjddddd}|jtjjd}g}| d¡| ¡D]}| |d¡q8tdd |d S) NÚlatancyÚxxú 10.100.17.89©ÚuserÚpasswordÚhostZdatabase©Zcursor_factoryz0select distinct host from ping order by host ascr¶zmap.htmlr’)rFZ collectors) Úpsycopg2ÚconnectÚcursorÚextrasÚ DictCursorÚexecuteÚfetchallr r)Ú connectionrºÚoutÚxrrrÚ map_display}s  rÂz/ix/map/data/c Cs–tjddddd}|jtjjd}| d|f¡| ¡d}| d||f¡g}| ¡D].}| |d |d |d |d |d dœ¡qXt ||dœƒS)Nr°r±r²r³r·zbselect date_trunc('minute', time) as t_time from ping where host = %s order by t_time DESC LIMIT 1ra%select ping.url as metric,CONCAT('AS', network) as asn,latitude,longitude,minimum_response_ms AS average_response_ms from ping left join ping_points ON (ping.url = ping_points.url) where host = %s and minimum_response_ms is not null and latitude is not null and date_trunc('minute', time) = %sÚmetricrÚlatitudeÚ longitudeZaverage_response_ms)ÚurlrrÄrÅÚms)ÚtimeZpoints) r¸r¹rºr»r¼r½Zfetchoner¾r r)Z collectorr¿rºZ fetch_timerÀrÁrrrÚmap_data‰s  ,rÉú/cCstdƒS)Nz index.html)rrrrrÚ index_pagešsrËÚ__main__z0.0.0.0)r¶Údebug)T)T)=ZflaskrrrrrrZ peeringdbrZpeeringdb.clientr Znumpyr r©r Úrer rgr r‡rrhZsqlite3Zgeoip2.databaseZgeoip2r¸Zpsycopg2.extrasr{rrfZwerkzeug.utilsrZ scapy.allrRÚ__name__rMrNr2r%r(r0r<r=r>ZrouterZrlr€r…r‹r™r£r¤r¥r¬r­r¯rÂrÉrËÚrunrrrrÚsf          2  <