I0521 10:16:27.298372 31 main.cpp:54] Using ice config /usr/local/algo_test_server/config/atts_ice.conf
I0521 10:16:27.448849 31 ResourceMonitor.cpp:369] Found GPU: 1 device
I0521 10:16:27.448889 31 ResourceMonitor.cpp:372] Found GPU with id:0
I0521 10:16:27.462859 31 ResourceMonitor.cpp:122] Found allowed cpu list:0-47
I0521 10:16:27.466676 31 utils.hpp:165] Found CPU brand:Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
Looking in indexes: https://mirrors.aliyun.com/pypi/simple
Requirement already satisfied: pillow in /usr/local/lib/python3.6/dist-packages (from -r /test-code/client/algo_test_client/requirements.txt (line 1)) (6.2.2)
Requirement already satisfied: requests in /usr/local/lib/python3.6/dist-packages (from -r /test-code/client/algo_test_client/requirements.txt (line 2)) (2.22.0)
Requirement already satisfied: lxml in /usr/local/lib/python3.6/dist-packages (from -r /test-code/client/algo_test_client/requirements.txt (line 3)) (4.5.1)
Requirement already satisfied: numpy in /usr/local/lib/python3.6/dist-packages (from -r /test-code/client/algo_test_client/requirements.txt (line 4)) (1.18.1)
Requirement already satisfied: pandas in /usr/local/lib/python3.6/dist-packages (from -r /test-code/client/algo_test_client/requirements.txt (line 5)) (1.0.3)
Requirement already satisfied: zeroc-ice==3.6.5 in /usr/local/lib/python3.6/dist-packages (from -r /test-code/client/algo_test_client/requirements.txt (line 6)) (3.6.5)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.6/dist-packages (from requests->-r /test-code/client/algo_test_client/requirements.txt (line 2)) (2019.11.28)
Requirement already satisfied: idna<2.9,>=2.5 in /usr/local/lib/python3.6/dist-packages (from requests->-r /test-code/client/algo_test_client/requirements.txt (line 2)) (2.8)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.6/dist-packages (from requests->-r /test-code/client/algo_test_client/requirements.txt (line 2)) (1.25.8)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python3.6/dist-packages (from requests->-r /test-code/client/algo_test_client/requirements.txt (line 2)) (3.0.4)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.6/dist-packages (from pandas->-r /test-code/client/algo_test_client/requirements.txt (line 5)) (2020.1)
Requirement already satisfied: python-dateutil>=2.6.1 in /usr/local/lib/python3.6/dist-packages (from pandas->-r /test-code/client/algo_test_client/requirements.txt (line 5)) (2.8.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.6/dist-packages (from python-dateutil>=2.6.1->pandas->-r /test-code/client/algo_test_client/requirements.txt (line 5)) (1.14.0)
2020-05-21 10:16:29,565 - root - INFO - Input env:{"TEST_CALLBACK_URL": "http://eagle-nest-backend-service.default.svc.cluster.local/api/callback/service-deal-with/1032/5", "JSON_PARAMS_FILENAME": "/test-tmp/1032-1590056155OL46.json", "JSON_PARAMS_PATH": "http://eagle-nest-backend-service.default.svc.cluster.local/storage/test-tmp/1032-1590056155OL46.json"}
2020-05-21 10:16:29,607 - root - INFO - ice.communicator------
2020-05-21 10:16:29,615 - root - INFO - Algorithm init info:{'auth_args': {'license_file': '/usr/local/ev_sdk/bin/license.txt', 'private_key': '/usr/local/ev_sdk/authorization/privateKey.pem', 'public_key': '/usr/local/ev_sdk/authorization/pubKey.pem', 'enable': False}}
2020-05-21 10:16:29,616 - root - INFO - input_conf:
2020-05-21 10:16:30,135 - root - INFO - Start running task
2020-05-21 10:16:30,136 - root - INFO - Running executor:
2020-05-21 10:16:30,136 - root - INFO - Running executor: {'input_generator': , 'auth_args': {'license_file': '/usr/local/ev_sdk/bin/license.txt', 'private_key': '/usr/local/ev_sdk/authorization/privateKey.pem', 'public_key': '/usr/local/ev_sdk/authorization/pubKey.pem', 'enable': False}}
2020-05-21 10:16:30,138 - root - INFO - Start monitoring resource...
I0521 10:16:30.165850 84 RunningStatus.cpp:44] resetting status
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0521 10:16:30.195951 147 functional_test.cpp:22] Loading dll...
I0521 10:16:30.196827 147 functional_test.cpp:31] Successfully load dll!
I0521 10:16:30.196849 147 functional_test.cpp:34] Testing ji_create_predictor
I0521 10:16:30.550349 147 SampleDetectorImplPy.cpp:113] Loading ji.py...
I0521 10:16:33.350500 147 SampleDetectorImplPy.cpp:122] ji python module successfully loaded.
I0521 10:16:33.350560 147 SampleDetectorImplPy.cpp:129] init loaded.
I0521 10:16:33.350572 147 SampleDetectorImplPy.cpp:129] process_image loaded.
INFO:root:Loading model...
I0521 10:16:38.849792 147 ji.cpp:112] SamplePredictor init OK.
I0521 10:16:38.849833 147 functional_test.cpp:44] Passed.
I0521 10:16:38.849838 147 functional_test.cpp:47] Testing ji_calc_frame
I0521 10:16:38.972870 147 functional_test.cpp:61] Passed.
I0521 10:16:38.972898 147 functional_test.cpp:64] Testing ji_destroy_predictor...
Exception ignored in:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 1289, in _shutdown
assert tlock.locked()
SystemError: returned a result with an error set
I0521 10:16:39.154130 147 functional_test.cpp:74] Passed.
func-test returned status:0
I0521 10:16:39.613001 84 utils.hpp:120]
I0521 10:16:39.613121 84 SDKService.cpp:145] func-test result:
2020-05-21 10:16:39,636 - root - INFO - first step test result:
{
statusCode = SuccessProcess
msg = On process success.
}
I0521 10:16:39.637291 84 RunningStatus.cpp:44] resetting status
E0521 10:16:39.637327 84 SDKService.cpp:121] EV_SDK not load, loading...
I0521 10:16:39.638129 84 SDKService.cpp:71] Reloading ev sdk...
I0521 10:16:39.638141 84 DllLoader.cpp:19] Loading dll...
I0521 10:16:39.639240 84 DllLoader.cpp:31] Successfully load dll!
I0521 10:16:39.639282 84 EVSdkCaller.cpp:134] Successfully load apis!
I0521 10:16:39.639290 84 SDKService.cpp:96] Done.
I0521 10:16:39.639297 84 SDKService.cpp:127] Initializing algorithm with args:
I0521 10:16:39.639492 84 EVSdkCaller.cpp:291] ji_init on success!
I0521 10:16:39.863106 84 SampleDetectorImplPy.cpp:113] Loading ji.py...
I0521 10:16:42.006755 84 SampleDetectorImplPy.cpp:122] ji python module successfully loaded.
I0521 10:16:42.006801 84 SampleDetectorImplPy.cpp:129] init loaded.
I0521 10:16:42.006812 84 SampleDetectorImplPy.cpp:129] process_image loaded.
INFO:root:Loading model...
I0521 10:16:48.341303 84 ji.cpp:112] SamplePredictor init OK.
I0521 10:16:48.341392 84 RunningStatus.cpp:32] setting status:20483, msg:ji_init on success!
I0521 10:16:48.341398 84 RunningStatus.cpp:34] Setting status code:20483, msg:ji_init on success!
I0521 10:16:48.341405 84 EVSdkCaller.cpp:306] Algorithm inited!
I0521 10:16:48.341421 84 SDKService.cpp:132] Successfully initializing algorithm!
I0521 10:16:48.342608 84 ResourceMonitor.cpp:272] pid=33626, gpu usage=905MB
2020-05-21 10:16:48,361 - root - INFO - algorithm init res:
{
statusCode = SuccessAlgorithmInit
msg = ji_init on success!
}
I0521 10:16:48.362562 84 RunningStatus.cpp:44] resetting status
I0521 10:16:48.510257 84 EVSdkCaller.cpp:463] ji_calc_frame return value:0
I0521 10:16:48.510309 84 RunningStatus.cpp:32] setting status:20484, msg:ji_calc_frame on success.
I0521 10:16:48.510314 84 RunningStatus.cpp:34] Setting status code:20484, msg:ji_calc_frame on success.
2020-05-21 10:16:48,510 - root - INFO - process result:
{
jiEventCode = 0
jiEventJson = {
"objects": []
}
statusCode = SuccessAPIRun
timeCost = 147719
}
I0521 10:16:48.517402 84 RunningStatus.cpp:44] resetting status
E0521 10:16:48.523571 84 SampleDetectorImplPy.cpp:85] process_image failed.
E0521 10:16:48.523610 84 EVSdkCaller.cpp:388] Cannot save output frame! data:`0`, save path:/usr/local/ev_sdk/output/13/LSmask20200203_1009.jpg
*** Aborted at 1590056208 (unix time) try "date -d @1590056208" if you are using GNU date ***
PC: @ 0x7f613853b746 strlen
*** SIGSEGV (@0x0) received by PID 31 (TID 0x7f60bb820700) from PID 0; stack trace: ***
@ 0x7f613ca09390 (unknown)
@ 0x7f613853b746 strlen
@ 0x41b2cd EVSdkCaller::processData()
@ 0x41ca0f EVSdkCaller::onDataReceived()
@ 0x4597f4 SDKService::process()
@ 0x40f6a8 AlgorithmMod::AlgorithmProcessor::___process()
@ 0x7f613bf912b3 IceInternal::Incoming::invoke()
@ 0x7f613bf67b5e (unknown)
@ 0x7f613bf68110 (unknown)
@ 0x7f613bf6a5e3 (unknown)
@ 0x7f613c07cda7 (unknown)
@ 0x7f613c07db08 (unknown)
@ 0x7f613bc51b8d (unknown)
@ 0x7f613c9ff6ba start_thread
@ 0x7f61385b741d clone
@ 0x0 (unknown)
2020-05-21 10:16:50,630 - root - ERROR - Failed to run api, remote connection closed.
Exception in thread Thread-1:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "/test-code/client/algo_test_client/executor.py", line 115, in start
for res in self.generate_data():
File "/test-code/client/algo_test_client/executor.py", line 360, in generate_data
res = self.algorithm_prx.getResourcesUsage(json.dumps(request_args))
File "/test-code/client/algo_test_client/AlgorithmMod_ice.py", line 371, in getResourcesUsage
return _M_AlgorithmMod.AlgorithmProcessor._op_getResourcesUsage.invoke(self, ((request, ), _ctx))
Ice.ConnectionLostException: Ice.ConnectionLostException:
Connection reset by peer

2020-05-21 10:16:50,862 - root - INFO - on executor finished!
2020-05-21 10:16:50,864 - root - ERROR - Remote already closed!
2020-05-21 10:16:50,864 - root - INFO - on executor finished!
2020-05-21 10:16:51,036 - root - INFO - on executor finished!
2020-05-21 10:16:51,037 - root - ERROR - Remote already closed!
2020-05-21 10:16:51,038 - root - INFO - {
"data": {
"json_params_filename": "/test-tmp/1032-1590056155OL46.json",
"original_data": {}
},
"code": 4100,
"msg": "Failed to run api!"
}