-
Python versus Perl for text mining
July 19th, 2009
I love Python. However when I’m working with large files (say > 100,000 records) i find that Perl is considerably faster for processing that text and uses much less memory. Perl was originally designed for text processing so I guess it is more optimized for that task. So my preprocessing is usually a mix of Perl and Python … then the app to automate and integrate that with a database is usually all python and the front end is usually XHMTL, CSS, Php and Javascript.
Different tools for different jobs I guess?