-
Notifications
You must be signed in to change notification settings - Fork 59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
is fast_excel thread safe? #27
Comments
I believe
According to my benchmarks How many rows are you trying to write? |
This This view is about ~750k rows, but I have bigger data too to export. |
Querying with offset/limit may be slow, depends on query inside view, usually every next request will take longer time. Splitting query with primary key range will be faster (like I would suggest to use database client directly (also can get it from Then it will fetch records and write to excel one by one, should be very memory efficient Mysql: https://github.com/brianmario/mysql2#streaming |
It's a bit better now, thanks for the idea. |
Hey!
We have some data, and want to query it from the DB, and export it to excel.
So the problem is, I want to write it parallelly.
But the result is weird. Sometimes I have the half of the data, and sometimes a bit more. (but without empty rows!! which is super weird)
So the question is,
fast_excel
is thread unsafe, or I did miss something?The text was updated successfully, but these errors were encountered: