All Forums  Origin Forum  Origin Forum  Problems with very large datasets with wavelets

Note: You must be registered in order to post a reply.
To register, click here. Registration is FREE!

Screensize: 640 x 480 800 x 600 1024 x 768 1280 x 1024 UserName: Password: Anti-Spam Code: Format Mode: Basic  Help  Prompt  Format: Font Andale Mono Arial Arial Black Book Antiqua Century Gothic Comic Sans MS Courier New Georgia Impact Lucida Console Script MT Bold Stencil Tahoma Times New Roman Trebuchet MS Verdana   Size 1 2 3 4 5 6   Color Black Red Yellow Pink Green Orange Purple Blue Beige Brown Teal Navy Maroon LimeGreen Message: * HTML is OFF * Forum Code is ON Smilies [quote][i]Originally posted by andrewdsto[/i] [br]Origin Ver. 2016 Pro and Service Release SR0 (Select Help-->About Origin): Operating System: Windows 7 Enterprise. Having upgraded to Origin 2016 from 2015 I am now having problems with very large datasets. I have datasets in the order of 4 million points (4 seconds of data at 1,000,000 samples/sec). My *.opj files can reach several GB in size. In Origin 2015 I could run the x-functions commands or use the analysis menu to process my datasets and it worked fine. eg: mdwt ix:=col(3) type:=%s$ ext:=pad0 level:=$(extralevels) rd:=[bkname$]MDWT!; Now in 2016 this command fails (with this size dataset) if I reduce the dataset to say 400,000 points (x10 decimation) it works. It does not matter if I run the code or used the MDWT from the analysis menu. Below is an capture of a failed MDWT ran from the analysis menu. interesting I believe the higher order columns are correct (when comparing to a series of dwt runs) its just the lower order columns are non-existent. I can successfully perform a single discrete wavelet transform (dwt)on my 4 million point dataset using both code or menu. [img]http://www.originlab.com/ftp/forum_and_kbase/Images/failed wavelet2.jpg[/img] A second problem I have found is performing a FFT on these same datasets. produce zero results see attached image. [img]http://www.originlab.com/ftp/forum_and_kbase/Images/failed fft.jpg[/img] Again the FFT worked on the smaller dataset. I repeat, I did not have this problem with Origin 2015. I do not know if other analysis menu items are affected. I checked with the SR 1&2 on the support page and no mention of a fix for this was mentioned. thanks Andrew [/quote]   Check here to include your profile signature. Check here to subscribe to this topic.