cluster: could not parse redisearch results #97
Description
issue coming from: https://github.com/RediSearch/RediSearch/actions/runs/10926464133/job/30338823638?pr=5026
2024-09-18T20:05:01.3822240Z 2024-09-18 20:05:01,381 INFO Executing remote command "wget https://s3.amazonaws.com/benchmarks.redislabs/redisearch/tools/ftsb/ftsb_redisearch_linux_amd64 -q -O /tmp/ftsb_redisearch"
2024-09-18T20:05:02.1128132Z INFO:root:Executing remote command "wget https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/1M-enwiki_abstract-hashes-text-no-sortable/1M-enwiki_abstract-hashes-text-no-sortable.redisearch.commands.BENCH.QUERY_simple-1word-query.csv -q -O /tmp/input.data"
2024-09-18T20:05:02.1131979Z 2024-09-18 20:05:02,112 INFO Executing remote command "wget https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/1M-enwiki_abstract-hashes-text-no-sortable/1M-enwiki_abstract-hashes-text-no-sortable.redisearch.commands.BENCH.QUERY_simple-1word-query.csv -q -O /tmp/input.data"
2024-09-18T20:05:06.9431398Z INFO:root:Executing remote command "chmod 755 /tmp/ftsb_redisearch"
2024-09-18T20:05:06.9433045Z 2024-09-18 20:05:06,942 INFO Executing remote command "chmod 755 /tmp/ftsb_redisearch"
2024-09-18T20:05:07.0205923Z INFO:root:Finished up remote tool ftsb_redisearch requirements
2024-09-18T20:05:07.0207775Z 2024-09-18 20:05:07,020 INFO Finished up remote tool ftsb_redisearch requirements
2024-09-18T20:05:07.0209411Z INFO:root:Reusing cached remote file (located at /tmp/input.data ).
2024-09-18T20:05:07.0210992Z 2024-09-18 20:05:07,020 INFO Reusing cached remote file (located at /tmp/input.data ).
2024-09-18T20:05:07.0212319Z INFO:root:Running the benchmark with the following parameters:
2024-09-18T20:05:07.0216069Z Args array: ['/tmp/ftsb_redisearch', '--host', '10.3.0.226:20000', '--cluster-mode', '--workers', '32', '--requests', '50000', '--reporting-period', '1s', '--input', '/tmp/input.data', '--json-out-file', '/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out']
2024-09-18T20:05:07.0221768Z Args str: /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out
2024-09-18T20:05:07.0225181Z 2024-09-18 20:05:07,020 INFO Running the benchmark with the following parameters:
2024-09-18T20:05:07.0228999Z Args array: ['/tmp/ftsb_redisearch', '--host', '10.3.0.226:20000', '--cluster-mode', '--workers', '32', '--requests', '50000', '--reporting-period', '1s', '--input', '/tmp/input.data', '--json-out-file', '/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out']
2024-09-18T20:05:07.0234584Z Args str: /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out
2024-09-18T20:05:07.0237837Z INFO:root:Starting CPU collecing thread
2024-09-18T20:05:07.0238894Z 2024-09-18 20:05:07,020 INFO Starting CPU collecing thread
2024-09-18T20:05:07.0630008Z INFO:root:Connecting to remote server 3.14.141.238
2024-09-18T20:05:07.0631155Z 2024-09-18 20:05:07,062 INFO Connecting to remote server 3.14.141.238
2024-09-18T20:05:07.0899752Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.0902034Z 2024-09-18 20:05:07,089 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.0903288Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.0904603Z 2024-09-18 20:05:07,089 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:07.2403618Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:07.2406510Z 2024-09-18 20:05:07,239 INFO Authentication (publickey) successful!
2024-09-18T20:05:07.2407675Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:07.2408775Z 2024-09-18 20:05:07,239 INFO Authentication (publickey) successful!
2024-09-18T20:05:07.2409687Z INFO:root:Connected to remote server 3.14.141.238
2024-09-18T20:05:07.2410715Z 2024-09-18 20:05:07,240 INFO Connected to remote server 3.14.141.238
2024-09-18T20:05:07.2413518Z INFO:root:Executing remote command "/tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:07.2417549Z 2024-09-18 20:05:07,240 INFO Executing remote command "/tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:35.3091701Z WARNING:root:Exit status: 1 for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:35.3095948Z STDERR: []
2024-09-18T20:05:35.3119310Z STDOUT: [' setup writes/sec writes/sec updates/sec reads/sec cursor reads/sec deletes/sec current ops/sec total ops TX BW/sRX BW/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 200 (112.063) 0 (0.000) 0 (0.000) 200 (112.063) 200 0BB/s 23.7KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 2492 (115.967) 0 (0.000) 0 (0.000) 2492 (115.967) 2693 0BB/s 296.5KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 500 (117.311) 0 (0.000) 0 (0.000) 500 (117.311) 3193 0BB/s 59.4KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 800 (117.311) 0 (0.000) 0 (0.000) 800 (117.311) 3993 0BB/s 95KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 1999 (119.167) 0 (0.000) 0 (0.000) 1999 (119.167) 5993 0BB/s 237.2KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 400 (119.295) 0 (0.000) 0 (0.000) 400 (119.295) 6393 0BB/s 47.5KB/s\n', '2024/09/18 20:05:35 could not parse redisearch results\n']
2024-09-18T20:05:35.3131690Z 2024-09-18 20:05:35,307 WARNING Exit status: 1 for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:35.3133631Z STDERR: []
2024-09-18T20:05:35.3147355Z STDOUT: [' setup writes/sec writes/sec updates/sec reads/sec cursor reads/sec deletes/sec current ops/sec total ops TX BW/sRX BW/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 200 (112.063) 0 (0.000) 0 (0.000) 200 (112.063) 200 0BB/s 23.7KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 2492 (115.967) 0 (0.000) 0 (0.000) 2492 (115.967) 2693 0BB/s 296.5KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 500 (117.311) 0 (0.000) 0 (0.000) 500 (117.311) 3193 0BB/s 59.4KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 800 (117.311) 0 (0.000) 0 (0.000) 800 (117.311) 3993 0BB/s 95KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 1999 (119.167) 0 (0.000) 0 (0.000) 1999 (119.167) 5993 0BB/s 237.2KB/s\n', ' 0 (0.000) 0 (0.000) 0 (0.000) 400 (119.295) 0 (0.000) 0 (0.000) 400 (119.295) 6393 0BB/s 47.5KB/s\n', '2024/09/18 20:05:35 could not parse redisearch results\n']
2024-09-18T20:05:35.3158485Z ERROR:root:Exit status of remote command execution 1. Printing stdout and stderr
2024-09-18T20:05:35.3159575Z 2024-09-18 20:05:35,308 ERROR Exit status of remote command execution 1. Printing stdout and stderr
2024-09-18T20:05:35.3161910Z INFO:root:Exit status for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: 1
2024-09-18T20:05:35.3165320Z 2024-09-18 20:05:35,308 INFO Exit status for command /tmp/ftsb_redisearch --host 10.3.0.226:20000 --cluster-mode --workers 32 --requests 50000 --reporting-period 1s --input /tmp/input.data --json-out-file /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: 1
2024-09-18T20:05:35.3167421Z INFO:root: remote process stdout:
2024-09-18T20:05:35.3168008Z 2024-09-18 20:05:35,308 INFO remote process stdout:
2024-09-18T20:05:35.3168564Z ERROR:root: remote process stderr:
2024-09-18T20:05:35.3169133Z 2024-09-18 20:05:35,308 ERROR remote process stderr:
2024-09-18T20:05:35.3169711Z INFO:root:Stopping CPU collecting thread
2024-09-18T20:05:35.3170335Z 2024-09-18 20:05:35,308 INFO Stopping CPU collecting thread
2024-09-18T20:05:38.7305807Z INFO:root:CPU collecting thread stopped
2024-09-18T20:05:38.7307157Z 2024-09-18 20:05:38,730 INFO CPU collecting thread stopped
2024-09-18T20:05:38.7308154Z INFO:root:Benchmark duration 28 secs.
2024-09-18T20:05:38.7309294Z 2024-09-18 20:05:38,730 INFO Benchmark duration 28 secs.
2024-09-18T20:05:38.7310878Z WARNING:root:Benchmark duration of 28 secs is bellow the considered minimum duration for a stable run (60 secs).
2024-09-18T20:05:38.7313564Z 2024-09-18 20:05:38,730 WARNING Benchmark duration of 28 secs is bellow the considered minimum duration for a stable run (60 secs).
2024-09-18T20:05:38.7317097Z ERROR:root:Given the remote tool failed, inspecting the remote results file content (/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out)
2024-09-18T20:05:38.7321835Z 2024-09-18 20:05:38,730 ERROR Given the remote tool failed, inspecting the remote results file content (/tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out)
2024-09-18T20:05:38.7725112Z INFO:root:Connecting to remote server 3.14.141.238
2024-09-18T20:05:38.7726522Z 2024-09-18 20:05:38,772 INFO Connecting to remote server 3.14.141.238
2024-09-18T20:05:38.8001367Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.8003329Z 2024-09-18 20:05:38,799 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.8004342Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.8005394Z 2024-09-18 20:05:38,799 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:38.9493790Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:38.9495835Z 2024-09-18 20:05:38,949 INFO Authentication (publickey) successful!
2024-09-18T20:05:38.9497529Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:38.9498675Z 2024-09-18 20:05:38,949 INFO Authentication (publickey) successful!
2024-09-18T20:05:38.9499451Z INFO:root:Connected to remote server 3.14.141.238
2024-09-18T20:05:38.9500247Z 2024-09-18 20:05:38,949 INFO Connected to remote server 3.14.141.238
2024-09-18T20:05:38.9501919Z INFO:root:Executing remote command "cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:38.9504316Z 2024-09-18 20:05:38,949 INFO Executing remote command "cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out"
2024-09-18T20:05:39.1038010Z WARNING:root:Exit status: 1 for command cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:39.1039955Z STDERR: []
2024-09-18T20:05:39.1041290Z STDOUT: ['cat: /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: No such file or directory\n']
2024-09-18T20:05:39.1043476Z 2024-09-18 20:05:39,103 WARNING Exit status: 1 for command cat /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out.
2024-09-18T20:05:39.1044972Z STDERR: []
2024-09-18T20:05:39.1046228Z STDOUT: ['cat: /tmp/benchmark-result-search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.out: No such file or directory\n']
2024-09-18T20:05:39.1047471Z WARNING:root:Remote results file content: []
2024-09-18T20:05:39.1048154Z 2024-09-18 20:05:39,103 WARNING Remote results file content: []
2024-09-18T20:05:39.1049922Z INFO:root:Total CPU usage (233.753 %)
2024-09-18T20:05:39.1050916Z 2024-09-18 20:05:39,104 INFO Total CPU usage (233.753 %)
2024-09-18T20:05:39.1461083Z INFO:root:Connecting to remote server 3.145.163.181
2024-09-18T20:05:39.1462453Z 2024-09-18 20:05:39,145 INFO Connecting to remote server 3.145.163.181
2024-09-18T20:05:39.1746648Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.1748399Z 2024-09-18 20:05:39,174 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.1749471Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.1750442Z 2024-09-18 20:05:39,174 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.3240241Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:39.3241918Z 2024-09-18 20:05:39,323 INFO Authentication (publickey) successful!
2024-09-18T20:05:39.3242870Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:39.3243778Z 2024-09-18 20:05:39,323 INFO Authentication (publickey) successful!
2024-09-18T20:05:39.3244539Z INFO:root:Connected to remote server 3.145.163.181
2024-09-18T20:05:39.3245357Z 2024-09-18 20:05:39,323 INFO Connected to remote server 3.145.163.181
2024-09-18T20:05:39.3247183Z INFO:root:Executing remote command "zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*"
2024-09-18T20:05:39.3249874Z 2024-09-18 20:05:39,323 INFO Executing remote command "zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*"
2024-09-18T20:05:39.9417273Z WARNING:root:Exit status: 12 for command zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*.
2024-09-18T20:05:39.9422108Z STDERR: ['\tzip warning: name not matched: /tmp/nkskzrwangskvpxckumm/*\n', '\n', 'zip error: Nothing to do! (try: zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip . -i /tmp/nkskzrwangskvpxckumm/*)\n']
2024-09-18T20:05:39.9424156Z STDOUT: []
2024-09-18T20:05:39.9425671Z 2024-09-18 20:05:39,941 WARNING Exit status: 12 for command zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip /tmp/nkskzrwangskvpxckumm/*.
2024-09-18T20:05:39.9428396Z STDERR: ['\tzip warning: name not matched: /tmp/nkskzrwangskvpxckumm/*\n', '\n', 'zip error: Nothing to do! (try: zip -r /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip . -i /tmp/nkskzrwangskvpxckumm/*)\n']
2024-09-18T20:05:39.9430051Z STDOUT: []
2024-09-18T20:05:39.9432360Z ERROR:root:The benchmark returned an error exit status. Fetching remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip into ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:39.9435947Z 2024-09-18 20:05:39,941 ERROR The benchmark returned an error exit status. Fetching remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip into ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:39.9439149Z INFO:root:Retrieving remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip from remote server 3.145.163.181
2024-09-18T20:05:39.9441634Z 2024-09-18 20:05:39,941 INFO Retrieving remote file /home/ubuntu/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip from remote server 3.145.163.181
2024-09-18T20:05:39.9444282Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9445892Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9446194Z
2024-09-18T20:05:39.9447705Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9449382Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9449677Z
2024-09-18T20:05:39.9451121Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9452695Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9452988Z
2024-09-18T20:05:39.9454476Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9456099Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9456394Z
2024-09-18T20:05:39.9457843Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9459404Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9459698Z
2024-09-18T20:05:39.9461177Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9462807Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9463103Z
2024-09-18T20:05:39.9464574Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9466170Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9466462Z
2024-09-18T20:05:39.9468079Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9469870Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9470482Z
2024-09-18T20:05:39.9472130Z WARNING:py.warnings:/usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9473742Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9474204Z
2024-09-18T20:05:39.9475710Z 2024-09-18 20:05:39,941 WARNING /usr/local/lib/python3.9/dist-packages/pysftp/__init__.py:61: UserWarning: Failed to load HostKeys from /github/home/.ssh/known_hosts. You will need to explicitly load HostKeys (cnopts.hostkeys.load(filename)) or disableHostKey checking (cnopts.hostkeys = None).
2024-09-18T20:05:39.9477349Z warnings.warn(wmsg, UserWarning)
2024-09-18T20:05:39.9477848Z
2024-09-18T20:05:39.9933505Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.9934668Z 2024-09-18 20:05:39,993 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.9935506Z INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:39.9936367Z 2024-09-18 20:05:39,993 INFO Connected (version 2.0, client OpenSSH_8.2p1)
2024-09-18T20:05:40.1507697Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:40.1509009Z 2024-09-18 20:05:40,150 INFO Authentication (publickey) successful!
2024-09-18T20:05:40.1510119Z INFO:paramiko.transport:Authentication (publickey) successful!
2024-09-18T20:05:40.1511181Z 2024-09-18 20:05:40,150 INFO Authentication (publickey) successful!
2024-09-18T20:05:40.3232998Z INFO:paramiko.transport.sftp:[chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3234227Z 2024-09-18 20:05:40,322 INFO [chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3235235Z INFO:paramiko.transport.sftp:[chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3236262Z 2024-09-18 20:05:40,322 INFO [chan 0] Opened sftp connection (server version 3)
2024-09-18T20:05:40.3338987Z ERROR:root:Unable to fetch remote file: [Errno 2] No such file
2024-09-18T20:05:40.3341344Z 2024-09-18 20:05:40,333 ERROR Unable to fetch remote file: [Errno 2] No such file
2024-09-18T20:05:40.3342853Z INFO:paramiko.transport.sftp:[chan 0] sftp session closed.
2024-09-18T20:05:40.3344289Z 2024-09-18 20:05:40,333 INFO [chan 0] sftp session closed.
2024-09-18T20:05:40.3345561Z INFO:paramiko.transport.sftp:[chan 0] sftp session closed.
2024-09-18T20:05:40.3346976Z 2024-09-18 20:05:40,333 INFO [chan 0] sftp session closed.
2024-09-18T20:05:40.3351892Z INFO:root:Uploading file ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip to s3. s3 bucket name: ci.benchmarks.redislabs. s3 bucket path: RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/
2024-09-18T20:05:40.3357857Z 2024-09-18 20:05:40,333 INFO Uploading file ./search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip to s3. s3 bucket name: ci.benchmarks.redislabs. s3 bucket path: RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/
2024-09-18T20:05:40.3361243Z INFO:root:-- uploading results to s3 --
2024-09-18T20:05:40.3362308Z 2024-09-18 20:05:40,334 INFO -- uploading results to s3 --
2024-09-18T20:05:40.3363390Z INFO:root:-- Using default AWS credentials --
2024-09-18T20:05:40.3364449Z 2024-09-18 20:05:40,334 INFO -- Using default AWS credentials --
2024-09-18T20:05:40.3870838Z
2024-09-18T20:05:40.3872688Z setup writes/sec writes/sec updates/sec reads/sec cursor reads/sec deletes/sec current ops/sec total ops TX BW/sRX BW/s
2024-09-18T20:05:40.3874640Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3875857Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3877034Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3878681Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3879824Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3880970Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3882117Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3883207Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3884237Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3885238Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3886231Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 (0.000) 0 0BB/s 0BB/s
2024-09-18T20:05:40.3887298Z 0 (0.000) 0 (0.000) 0 (0.000) 200 (112.063) 0 (0.000) 0 (0.000) 200 (112.063) 200 0BB/s 23.7KB/s
2024-09-18T20:05:40.3888414Z 0 (0.000) 0 (0.000) 0 (0.000) 2492 (115.967) 0 (0.000) 0 (0.000) 2492 (115.967) 2693 0BB/s 296.5KB/s
2024-09-18T20:05:40.3889519Z 0 (0.000) 0 (0.000) 0 (0.000) 500 (117.311) 0 (0.000) 0 (0.000) 500 (117.311) 3193 0BB/s 59.4KB/s
2024-09-18T20:05:40.3890606Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3891650Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3892676Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3893716Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3894738Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3895751Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3896950Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3897988Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3899036Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3900653Z 0 (0.000) 0 (0.000) 0 (0.000) 0 (117.311) 0 (0.000) 0 (0.000) 0 (117.311) 3193 0BB/s 0BB/s
2024-09-18T20:05:40.3902252Z 0 (0.000) 0 (0.000) 0 (0.000) 800 (117.311) 0 (0.000) 0 (0.000) 800 (117.311) 3993 0BB/s 95KB/s
2024-09-18T20:05:40.3904119Z 0 (0.000) 0 (0.000) 0 (0.000) 1999 (119.167) 0 (0.000) 0 (0.000) 1999 (119.167) 5993 0BB/s 237.2KB/s
2024-09-18T20:05:40.3905826Z 0 (0.000) 0 (0.000) 0 (0.000) 400 (119.295) 0 (0.000) 0 (0.000) 400 (119.295) 6393 0BB/s 47.5KB/s
2024-09-18T20:05:40.3906827Z 2024/09/18 20:05:35 could not parse redisearch results
2024-09-18T20:05:40.5283718Z 0%| | 0/1 [00:00<?, ?files/s]
2024-09-18T20:05:40.5285246Z 100%|██████████| 1/1 [00:00<00:00, 7.09files/s]
2024-09-18T20:05:40.5286052Z 100%|██████████| 1/1 [00:00<00:00, 7.08files/s]
2024-09-18T20:05:40.5294406Z INFO:root:Artifact: search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip. URL: https://s3.***.amazonaws.com/ci.benchmarks.redislabs/RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:40.5300205Z 2024-09-18 20:05:40,528 INFO Artifact: search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip. URL: https://s3.***.amazonaws.com/ci.benchmarks.redislabs/RediSearch/RediSearch/results/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable/search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable_2024-09-18-20-05-00.log.zip
2024-09-18T20:05:40.6204662Z CRITICAL:root:Some unexpected exception was caught during remote work on test named search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable. Failing test....
2024-09-18T20:05:40.6211067Z 2024-09-18 20:05:40,619 CRITICAL Some unexpected exception was caught during remote work on test named search-ftsb-1M-enwiki_abstract-hashes-fulltext-simple-1word-query-non-sortable. Failing test....