Ethical Hacking

Learn to find vulnerabilities before the bad guys do! Gain real world hands on hacking experience in our state of the art hacking lab. Course designed and taught by expert instructors with years of penetration testing experience. 12 student maximum in every class. Certification attempt included in every package.
Computer Forensics Training at InfoSec Institute

Gain the in-demand skills of a certified computer examiner, learn to recover trace data left behind by fraud, theft, and cybercrime perpetrators. Discover the source of computer crime and abuse at your organization so that it never happens again. All of our class sizes are guaranteed to be 12 students or less to facilitate one-on-one interaction with one of our expert instructors.




Network Security Focus-IDS
[Top] [All Lists]

RE: parsing very large tcpdump files

Subject: RE: parsing very large tcpdump files
Date: Fri, 19 Nov 2004 13:54:38 -0600
Check out tcpick.sourceforge.net -- it's pretty cool and
can reassemble tcp streams on very large files, along
with a ton of other things.

        Brian

-----Original Message-----
From: Tom [mailto:digitalevidence@excite.com]
Sent: Thursday, November 18, 2004 5:30 PM
To: focus-ids@securityfocus.com
Subject: parsing very large tcpdump files



moderator: sorry if this is vague.  My requirements are not 
fixed yet and will probably change from case to case, 
therefore I am just looking for generic info now.



I was wondering if anyone on this list can recommend some 
tools (Opensource or commercial) to automate the parsing of 
very large (many GB) tcpdump files.  I am trying to put 
together a generic toolset but in general some things I'd 
like to do are:



1. Filter out traffic to/from a specific IP address or range

2. Reconstruct all reconstructable sessions in an easy to 
parse way: emails, web sites visited (and content 
uploaded/downloaded), voip, anything else imaginable.

3. Be able to search all of this data for keywords. 



This may seem like a tall order.  I know of a few tools to do 
individual tasks on a small scale, such as mailsnarf, vomit, 
ethereal,  etc. but it's not practical to use ethereal to 
parse these by hand. I've tried chaosreader.pl but it bogs 
down on files as small as 200 MB.



I'd appreciate any input.



Thanks.





_______________________________________________
Join Excite! - http://www.excite.com
The most personalized portal on the Web!

--------------------------------------------------------------
------------
Test Your IDS

Is your IDS deployed correctly?
Find out quickly and easily by testing it with real-world 
attacks from 
CORE IMPACT.
Go to 
http://www.securityfocus.com/sponsor/CoreSecurity_focus-ids_040708 
to learn more.
--------------------------------------------------------------
------------



--------------------------------------------------------------------------
Test Your IDS

Is your IDS deployed correctly?
Find out quickly and easily by testing it with real-world attacks from 
CORE IMPACT.
Go to http://www.securityfocus.com/sponsor/CoreSecurity_focus-ids_040708 
to learn more.
--------------------------------------------------------------------------


<Prev in Thread] Current Thread [Next in Thread>