curl#18 - "transfer closed with XXXXXXX bytes remaining to read

[Juan4SAS]

Hello everyone,

after several kind of issues, some thankfully supported by Younes / @frayos , some I could resolve myself, I am hitting a new issue. I hope you can give me a hand with it.

First of all, the error is not very clear. When I trace back the previous issues in the log, I can find several messages of the kind:
"http://172.22.168.128:180/sas_repos/repos/shipped/dmdq/125/dmdq-125-x64_redhat_linux_6-yum/Packages/s/sas-qkb-ci-31.1.5-20190523.1558632690288.x86_64.rpm: [Errno 14] curl#18 - \"transfer closed with 290822683 bytes remaining to read\""

Several messsages in the logs tell me the local mirror is reachable. Just to be sure, I added the following to the Dockerfile:
# 20210314 Test connection to local mirror and get IP RUN set -e; \ echo; echo "####### 20210314 Test connection to local mirror and get IP"; echo; \ echo $(hostname -a); \ echo $(hostname -A); \ echo $(hostname -d); \ echo $(hostname -i); \ echo $(nc -zv 172.22.168.128 180); \ curl --remote-name http://172.22.168.128:180/sas_repos/repos/shipped/dmdq/125/dmdq-125-x64_redhat_linux_6-yum/Packages/s ; \ curl http://172.22.168.128:180/sas_repos/repos/shipped/dmdq/125/dmdq-125-x64_redhat_linux_6-yum/Packages/s ; \ echo; echo "####### 20210314 END Test connection to local mirror and get IP"; echo;

The results are satisfactory from the container itself.

Just as a reminder, I am executing the following command:
./build.sh --type single --zip ../SAS_Viya_deployment_data.zip --addons "auth-demo" -m http://172.22.168.128:180/sas_repos -u localhost:5000 -i localhost:5000/va-125-x64_redhat_linux_7-docker/sas-viya-programming -t 3.5.9-20201210.1607626389474 --tag v1 -p redhat --verbose --debug

Any ideas?

Attaching the log file. I hope it helps.

log.txt

Thank you in advance!
Best regards,
Juan

[frayos]

@Juan4SAS
How are you serving your mirror ? I've seen this issue with "SimpleHTTP Server" as it's single threaded.

Thanks !
Younes

[Juan4SAS]

@frayos
I default apache2 server. It is interesting that you point to the multi-threading, it made me check the mpm configuration file.
<IfModule mpm_event_module> StartServers 2 MinSpareThreads 25 MaxSpareThreads 75 ThreadLimit 64 ThreadsPerChild 25 MaxRequestWorkers 150 MaxConnectionsPerChild 0 </IfModule>

I could not find any description, though, about the HTTP server requirements to serve the SAS Mirror locally.
If it is documented, could you please share the link to the specific document? And, otherwise:

• Could you please let me know the minimum requirements for the SAS mirror?
• Could you perhaps make a note in the SAS documentation to include further details about min requirements for a local SAS mirror, if you think that would be a good idea?

Thank you again!
Juan