Search found 4 matches
- Fri Nov 16, 2007 8:14 am
- Forum: Python Study Group
- Topic: Any extra Ideas
- Replies: 5
- Views: 21851
That did work it was about the same speed it's just a ton of data I'm reading 30MB file about a min and a half. Truly I need to get a hold of the guys that did the first program he used MS SQL to get around reading the files just it's not easy to get in touch with him. I've got another project that ...
- Fri Nov 16, 2007 7:49 am
- Forum: Python Study Group
- Topic: Any extra Ideas
- Replies: 5
- Views: 21851
That did work it was about the same speed it's just a ton of data I'm reading 30MB file about a min and a half. Truly I need to get a hold of the guys that did the first program he used MS SQL to get around reading the files just it's not easy to get in touch with him. I've got another project that ...
- Fri Nov 09, 2007 9:09 am
- Forum: Python Study Group
- Topic: Any extra Ideas
- Replies: 5
- Views: 21851
riddle I've gotten it to run the 138MB file in about 10-14 mins just by reading the whole file into memory. I've been thinking about putting python to work by using "For line in file" Or using sql to speed it up more since a DB would be optimum. If you come up with better let me know My big problem ...
- Mon Oct 15, 2007 11:10 am
- Forum: Python Study Group
- Topic: Any extra Ideas
- Replies: 5
- Views: 21851
Any extra Ideas
Hey Everyone been working on a python program that reads though some pretty big data files 100MB is the smallest. All are tab delineated so it's quite a bit of data to parse though. I've already setup filters to narrow the about down which speeds it up. Just wanting some others ideas that might help...