This page shows the benchmarks results for the dataset “caltech-large”. The reported values, bounds and accuracies are averaged across all instances of the dataset.
Run time 1s
| method | avg value | avg bound | feasible | optimal | accuracy |
|---|---|---|---|---|---|
| dd-ls0 | -26236.1 | -56071.2 | 9 / 9 | 0 / 1 | 47.62% |
| dd-ls3 | -25226.2 | -72766.1 | 9 / 9 | 0 / 1 | 44.26% |
| dd-ls4 | -25268.3 | -79326.9 | 9 / 9 | 0 / 1 | 45.89% |
| fgmd | inf | -inf | 0 / 9 | 0 / 1 | – |
| fm-bca | -33758.2 | -48582.2 | 9 / 9 | 0 / 1 | 51.41% |
| fm | -33972.4 | -142829 | 9 / 9 | 0 / 1 | 51.87% |
| fw | 0 | -inf | 9 / 9 | 0 / 1 | – |
| ga | inf | -inf | 0 / 9 | 0 / 1 | – |
| hbp | inf | -inf | 0 / 9 | 0 / 1 | – |
| ipfps | inf | -inf | 7 / 9 | 0 / 1 | – |
| ipfpu | inf | -inf | 8 / 9 | 0 / 1 | – |
| lsm | inf | -inf | 0 / 9 | 0 / 1 | – |
| mp | -31315.3 | -46169.9 | 9 / 9 | 0 / 1 | 48.15% |
| mp-fw | -34227.2 | -51526 | 9 / 9 | 0 / 1 | 50.75% |
| mpm | inf | -inf | 0 / 9 | 0 / 1 | – |
| mp-mcf | -29812.5 | -48167.8 | 9 / 9 | 0 / 1 | 45.22% |
| pm | -29106.2 | -inf | 9 / 9 | 0 / 1 | 42.56% |
| rrwm | inf | -inf | 6 / 9 | 0 / 1 | – |
| sm | inf | -inf | 8 / 9 | 0 / 1 | – |
| smac | inf | -inf | 8 / 9 | 0 / 1 | – |
Run time 10s
| method | avg value | avg bound | feasible | optimal | accuracy |
|---|---|---|---|---|---|
| dd-ls0 | -32973.2 | -35007.1 | 9 / 9 | 1 / 1 | 51.43% |
| dd-ls3 | -28653.2 | -42079.5 | 9 / 9 | 1 / 1 | 48.52% |
| dd-ls4 | -25599.2 | -62120.5 | 9 / 9 | 0 / 1 | 45.53% |
| fgmd | inf | -inf | 0 / 9 | 0 / 1 | – |
| fm-bca | -34039.8 | -48222.8 | 9 / 9 | 0 / 1 | 51.09% |
| fm | -34117.4 | -142829 | 9 / 9 | 0 / 1 | 51.56% |
| fw | 0 | -inf | 9 / 9 | 0 / 1 | – |
| ga | inf | -inf | 0 / 9 | 0 / 1 | – |
| hbp | inf | -inf | 0 / 9 | 0 / 1 | – |
| ipfps | inf | -inf | 8 / 9 | 0 / 1 | – |
| ipfpu | -34215.8 | -inf | 9 / 9 | 0 / 1 | 52.09% |
| lsm | inf | -inf | 8 / 9 | 0 / 1 | – |
| mp | -32016.9 | -46070.3 | 9 / 9 | 0 / 1 | 47.73% |
| mp-fw | -34236.8 | -48882.3 | 9 / 9 | 0 / 1 | 50.75% |
| mpm | inf | -inf | 1 / 9 | 0 / 1 | – |
| mp-mcf | -30362.4 | -46630.5 | 9 / 9 | 0 / 1 | 47.43% |
| pm | -29106.2 | -inf | 9 / 9 | 0 / 1 | 42.56% |
| rrwm | inf | -inf | 8 / 9 | 0 / 1 | – |
| sm | -14423.1 | -inf | 9 / 9 | 0 / 1 | 27.88% |
| smac | -24182.6 | -inf | 9 / 9 | 0 / 1 | 38.98% |
Run time 100s
| method | avg value | avg bound | feasible | optimal | accuracy |
|---|---|---|---|---|---|
| dd-ls0 | -33538.8 | -34959.2 | 9 / 9 | 1 / 1 | 52.21% |
| dd-ls3 | -33551.6 | -34914.1 | 9 / 9 | 1 / 1 | 48.65% |
| dd-ls4 | -30148.3 | -38879.8 | 9 / 9 | 1 / 1 | 51.15% |
| fgmd | inf | -inf | 0 / 9 | 0 / 1 | – |
| fm-bca | -34072.8 | -48217.4 | 9 / 9 | 0 / 1 | 51.09% |
| fm | -34125.4 | -142829 | 9 / 9 | 0 / 1 | 51.56% |
| fw | 0 | -inf | 9 / 9 | 0 / 1 | – |
| ga | inf | -inf | 6 / 9 | 0 / 1 | – |
| hbp | inf | -inf | 0 / 9 | 0 / 1 | – |
| ipfps | -33998.2 | -inf | 9 / 9 | 0 / 1 | 51.08% |
| ipfpu | -34215.8 | -inf | 9 / 9 | 0 / 1 | 52.09% |
| lsm | 0 | -inf | 9 / 9 | 0 / 1 | – |
| mp | -32069.3 | -46065.9 | 9 / 9 | 0 / 1 | 48.00% |
| mp-fw | -34277.3 | -45922.6 | 9 / 9 | 1 / 1 | 51.01% |
| mpm | inf | -inf | 8 / 9 | 0 / 1 | – |
| mp-mcf | -30736.6 | -43833.3 | 9 / 9 | 0 / 1 | 46.75% |
| pm | -29106.2 | -inf | 9 / 9 | 0 / 1 | 42.56% |
| rrwm | inf | -inf | 8 / 9 | 0 / 1 | – |
| sm | -14423.1 | -inf | 9 / 9 | 0 / 1 | 27.88% |
| smac | -24182.6 | -inf | 9 / 9 | 0 / 1 | 38.98% |
Run time 300s
| method | avg value | avg bound | feasible | optimal | accuracy |
|---|---|---|---|---|---|
| dd-ls0 | -33538.8 | -34959.2 | 9 / 9 | 1 / 1 | 52.21% |
| dd-ls3 | -33557.1 | -34911.2 | 9 / 9 | 1 / 1 | 48.65% |
| dd-ls4 | -32266.4 | -35577.3 | 9 / 9 | 1 / 1 | 50.67% |
| fgmd | inf | -inf | 0 / 9 | 0 / 1 | – |
| fm-bca | -34082.4 | -48217.4 | 9 / 9 | 1 / 1 | 51.45% |
| fm | -34125.4 | -142829 | 9 / 9 | 0 / 1 | 51.56% |
| fw | 0 | -inf | 9 / 9 | 0 / 1 | – |
| ga | inf | -inf | 8 / 9 | 0 / 1 | – |
| hbp | inf | -inf | 0 / 9 | 0 / 1 | – |
| ipfps | -33998.2 | -inf | 9 / 9 | 0 / 1 | 51.08% |
| ipfpu | -34215.8 | -inf | 9 / 9 | 0 / 1 | 52.09% |
| lsm | 0 | -inf | 9 / 9 | 0 / 1 | – |
| mp | -32073.8 | -46065.6 | 9 / 9 | 0 / 1 | 48.36% |
| mp-fw | -34287.5 | -44424.4 | 9 / 9 | 1 / 1 | 50.72% |
| mpm | inf | -inf | 8 / 9 | 0 / 1 | – |
| mp-mcf | -31230.5 | -42564.1 | 9 / 9 | 0 / 1 | 48.40% |
| pm | -29106.2 | -inf | 9 / 9 | 0 / 1 | 42.56% |
| rrwm | inf | -inf | 8 / 9 | 0 / 1 | – |
| sm | -14423.1 | -inf | 9 / 9 | 0 / 1 | 27.88% |
| smac | -24182.6 | -inf | 9 / 9 | 0 / 1 | 38.98% |
Per Instance Results
Results for individual instances of the dataset are also available: