Dockerfile fails to build due to ERROR: No matching distribution found for pemja==0.1.4

[Brianbrifri]

Hello!

I'm currently trying to build your docker image from the dockerfile under pyflink-getting-started-on-aws/local/Dockerfile
When running the command: docker build -t=real-time-streaming-aws:1.17.1 . I'm getting the following error.

NOTE:
I'm running this on an M2 MacBook Pro.
I commented out the last line: RUN pip3 install apache-flink==${FLINK_VERSION} and it built properly. I was able to use that image in the compose-flink.yml file.
I exec'd into the running container and ran the command: pip3 install apache-flink==1.15.2 and the same error surfaced.
It is properly interpolating the ${FLINK_VERSION} variable as I ran it with an explicit 1.15.2 as well.
Do you have an idea what could be happening?

Thanks!

 => ERROR [3/3] RUN pip3 install apache-flink==1.15.2                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           57.8s
------
 > [3/3] RUN pip3 install apache-flink==1.15.2:
0.379 Collecting apache-flink==1.15.2
0.473   Downloading apache-flink-1.15.2.tar.gz (1.1 MB)
0.768 Collecting py4j==0.10.9.3
0.786   Downloading py4j-0.10.9.3-py2.py3-none-any.whl (198 kB)
0.820 Collecting python-dateutil==2.8.0
0.839   Downloading python_dateutil-2.8.0-py2.py3-none-any.whl (226 kB)
1.220 Collecting apache-beam==2.27.0
1.243   Downloading apache-beam-2.27.0.zip (2.4 MB)
1.562 Collecting cloudpickle==1.2.2
1.577   Downloading cloudpickle-1.2.2-py2.py3-none-any.whl (25 kB)
1.599 Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
1.617   Downloading avro-python3-1.9.2.1.tar.gz (37 kB)
2.766 Collecting pandas<1.2.0,>=1.0
2.783   Downloading pandas-1.1.5-cp38-cp38-manylinux2014_aarch64.whl (9.6 MB)
3.061 Collecting pyarrow<3.0.0,>=0.15.1
3.085   Downloading pyarrow-2.0.0.tar.gz (58.9 MB)
5.624   Installing build dependencies: started
50.52   Installing build dependencies: finished with status 'done'
50.53   Getting requirements to build wheel: started
50.62   Getting requirements to build wheel: finished with status 'done'
50.62     Preparing wheel metadata: started
50.76     Preparing wheel metadata: finished with status 'done'
50.86 Collecting pytz>=2018.3
50.87   Downloading pytz-2024.1-py2.py3-none-any.whl (505 kB)
51.19 Collecting numpy<1.20,>=1.14.3
51.23   Downloading numpy-1.19.5-cp38-cp38-manylinux2014_aarch64.whl (12.4 MB)
51.71 Collecting fastavro<0.24,>=0.21.4
51.73   Downloading fastavro-0.23.6.tar.gz (573 kB)
51.93 Collecting requests>=2.26.0
51.95   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
52.21 Collecting protobuf<3.18
52.23   Downloading protobuf-3.17.3-cp38-cp38-manylinux2014_aarch64.whl (923 kB)
52.28 Collecting apache-flink-libraries<1.15.3,>=1.15.2
52.31   Downloading apache-flink-libraries-1.15.2.tar.gz (233.7 MB)
57.57 Collecting pemja==0.1.4
57.58   Downloading pemja-0.1.4.tar.gz (32 kB)
57.66     ERROR: Command errored out with exit status 255:
57.66      command: /usr/local/bin/python3.8 -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-yi9ko81v/pemja_4c3552b72be94774b251e263cd291aaa/setup.py'"'"'; __file__='"'"'/tmp/pip-install-yi9ko81v/pemja_4c3552b72be94774b251e263cd291aaa/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-7ywcbiuu
57.66          cwd: /tmp/pip-install-yi9ko81v/pemja_4c3552b72be94774b251e263cd291aaa/
57.66     Complete output (1 lines):
57.66     Include folder should be at '/opt/java/openjdk/include' but doesn't exist. Please check you've installed the JDK properly.
57.66     ----------------------------------------
57.66 WARNING: Discarding https://files.pythonhosted.org/packages/8a/39/dfb9c9a1448a93f038e963f9efe988d6988c5316474ad725e8669b3e53a6/pemja-0.1.4.tar.gz#sha256=f9c3fd58cdff31170ebf9741f4d9fe2609494d9581289909b96c1b2415806d7a (from https://pypi.org/simple/pemja/) (requires-python:>=3.7). Command errored out with exit status 255: python setup.py egg_info Check the logs for full command output.
57.66 ERROR: Could not find a version that satisfies the requirement pemja==0.1.4 (from apache-flink) (from versions: 0.1.dev0, 0.1.0, 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.1.6, 0.2.0, 0.2.1, 0.2.2, 0.2.3, 0.2.4, 0.2.5, 0.2.6, 0.3.0, 0.3.1, 0.4.0, 0.4.1)
57.66 ERROR: No matching distribution found for pemja==0.1.4
57.66 WARNING: You are using pip version 21.1.1; however, version 23.3.2 is available.
57.66 You should consider upgrading via the '/usr/local/bin/python3.8 -m pip install --upgrade pip' command.
------
Dockerfile:24
--------------------
  22 |     
  23 |     # install PyFlink
  24 | >>> RUN pip3 install apache-flink==${FLINK_VERSION}
  25 |     
--------------------
ERROR: failed to solve: process "/bin/sh -c pip3 install apache-flink==${FLINK_VERSION}" did not complete successfully: exit code: 1

[jaehyeon-kim]

Hello,

You'd find the following stackoverflow post useful - https://stackoverflow.com/questions/77224718/docker-build-troubles-with-pyflink-container-creating

Cheers,
Jaehyeon