Skip to content

benchmark: fastgather vs fastmultigather vs fastmultigather x rocksdb #5

@ctb

Description

@ctb

chill-filter benchmarks

rocksdb still fastest!

fastgather

        Command being timed: "sourmash scripts fastgather ERR1395610.k51.s100_000.sig.zip ../prepare-db/plants+animals+gtdb.mf.csv -k 51 --scaled 100_000 -o xxx.csv"
        User time (seconds): 19.72
        System time (seconds): 1.16
        Percent of CPU this job got: 130%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 0:16.02
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 1018504
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 360633
        Voluntary context switches: 37
        Involuntary context switches: 660
        Swaps: 0
        File system inputs: 0
        File system outputs: 8
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

fastmultigather

        Command being timed: "sourmash scripts fastmultigather ERR1395610.k51.s100_000.sig.zip ../prepare-db/plants+animals+gtdb.mf.csv -k 51 --scaled 100_000"
        User time (seconds): 18.57
        System time (seconds): 1.17
        Percent of CPU this job got: 127%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 0:15.43
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 996920
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 1
        Minor (reclaiming a frame) page faults: 402592
        Voluntary context switches: 51
        Involuntary context switches: 765
        Swaps: 0
        File system inputs: 128
        File system outputs: 16
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0

fastmultigather x rocksdb

        User time (seconds): 7.78
       System time (seconds): 2.20
       Percent of CPU this job got: 100%
       Elapsed (wall clock) time (h:mm:ss or m:ss): 0:09.90
       Average shared text size (kbytes): 0
       Average unshared data size (kbytes): 0
       Average stack size (kbytes): 0
       Average total size (kbytes): 0
       Maximum resident set size (kbytes): 1272924
       Average resident set size (kbytes): 0
       Major (requiring I/O) page faults: 0
       Minor (reclaiming a frame) page faults: 848997
       Voluntary context switches: 99
       Involuntary context switches: 367
       Swaps: 0
       File system inputs: 0
       File system outputs: 0
       Socket messages sent: 0
       Socket messages received: 0
       Signals delivered: 0
       Page size (bytes): 4096
       Exit status: 0
      ```

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions