New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

data type conversion error #2222

Open

hrxx opened this issue May 20, 2022 · 1 comment

hrxx commented May 20, 2022

I can run my data process success on pandas, but when I switch to koalas, there are lots of data type errors, like that:

with type DataFrame: did not recognize Python value type when inferring an Arrow data type
<class 'str'>: (<class 'py4j.protocol.Py4JError'>, Py4JError('An error occurred while calling None.None'))

I think this error happens when transferring python data to java data. how to solve it, thanks!

Contributor

itholic commented May 20, 2022

Can you file a issue to Apache Spark JIRA ??

Koalas is ported to Apache Spark, under named "pandas API on Spark".

Can you try with pandas API on Spark, and see if it works? (otherwise, could you create a JIRA)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment