The Origin Forum
File Exchange
Try Origin for Free
The Origin Forum
Home | Profile | Register | Active Topics | Members | Search | FAQ | Send File to Tech support
Username:
Password:
Save Password
Forgot your Password? | Admin Options

 All Forums
 Origin Forum for Programming
 LabTalk Forum
 LabTalk SQL Database import super slow
 New Topic  Reply to Topic
 Printer Friendly
Author Previous Topic Topic Next Topic Lock Topic Edit Topic Delete Topic New Topic Reply to Topic

cgoerner

Germany
7 Posts

Posted - 11/08/2021 :  11:38:34 AM  Show Profile  Edit Topic  Reply with Quote  View user's IP address  Delete Topic
Origin Ver. and Service Release (Select Help-->About Origin): OriginPro 2019b (64-bit) 9.6.5.169
Operating System: Windows 10

Hi everyone!

I can't seem to figure out why my SQL database import is so slow under Origin. Using Excel or R, I can import the entire dataset in seconds, so it should work (the server is not at fault).

My script imports several datasets, and the flow is always the same:
page.active$ = [...]; // the page i want to import the data into
string query$="[...]"; // (no joins, SELECT and a few WHERE conditions, max. 100k rows * 15 to 20 columns)
dbEdit change conn:=DBsource$ sql:=query$;
dbImport;
dbedit execute:=remove;

The connection string DBsource$ was given to me by a colleague and works fine. In the status bar next to the orange Origin bubble at the bottom I can follow the import progress. It is so slow that I can actually follow the import with my own eyes, f.ex. it says "col(8), i= 8416 to 11220..." for a second, then the next 3000 rows and so on.

Does anyone have any ideas to speed this thing up?

Echo_Chu

China
Posts

Posted - 11/08/2021 :  11:10:08 PM  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
We did improve database speed from Origin 2020. Would you mind trying our latest version and see whether the speed is better?

you can download a free demo here:

http://www.originlab.com/index.aspx?go=Downloads/OriginEvaluation

If you still feel the speed is slow in the latest version, we can work together to see how we can test on your database to further identify the problem.


Echo
OriginLab Technical Service
Go to Top of Page

snowli

USA
1426 Posts

Posted - 11/09/2021 :  12:45:07 PM  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Hello,

You check out this blog to see the speed comparison between Origin 2020 and Origin 2019. It should be much faster since Origin 2020.
https://blog.originlab.com/better-faster-database-support-in-origin-2020

Thanks, Snow
Go to Top of Page

cgoerner

Germany
7 Posts

Posted - 11/10/2021 :  4:54:17 PM  Show Profile  Edit Reply  Reply with Quote  View user's IP address  Delete Reply
Thank you all for your advice, the imports work much faster now using the 2020 version!
Go to Top of Page
  Previous Topic Topic Next Topic Lock Topic Edit Topic Delete Topic New Topic Reply to Topic
 New Topic  Reply to Topic
 Printer Friendly
Jump To:
The Origin Forum © 2020 Originlab Corporation Go To Top Of Page
Snitz Forums 2000