Gentle Reader, I receive raw binary data by the gigabyte. I've gotten data from outside my company, with a request for help crunching it. But this isn't my day job and my management chain doesn't support me.
No matter. I'm a believer that the "simple model/lots of data" method is one good tool for problem solving. If nothing else, the challenge of do Lots with Nothing is a lot of fun! And, after some effort, I think I have a fairly solid solution. no Matlab seat and no more Random Access crashing.
The chart below shows my process. Each of these chunks works, beginning with raw binary .MDF files, through the waltz of perl, perl, Octave, SQL, TeX and a small C utility (thanks again, Tim! much better than my perl script). At the end I get slick looking .PDFs and a couple thousand rows in my database!
I figure the three or four people out there who are interested in this kind of stuff are either now wiping the drool off their chins, or laughing at my totally hacked together solution. Feel free to laugh it up but keep in mind this is MY blog, scoffers!
and Happy New Year to you!
Screen shots of various chunks. Octave system calls summon the MDF shredder, perl and MikTeX's pdflatex so those parts don't get their own window:
- nzvyyx
22JAN2011 edit: Tim the Mighty pointed out I should be using his .OCT file instead of calling the .EXE. Good point Tim! I had been using a perl script and I had no choice; unfortunately I didn't re-evaluate that process when I started using his SignalExtractor. Now data pipes directly to variables instead of requiring a lengthy csvread() call. Just goes to show you how a mental framework can steer one's judgement.
No comments:
Post a Comment