Critical Assessment of Fully Automated Structure Prediction


CAFASP4 PRELIMINARY STANDINGS

The CAFASP4 preliminary standings page contains preliminary results computed using the released targets so far. The results are preliminary and unofficial and are based on the number-1 model returned by the servers.

The table shows the servers and MQAPs with highest MaxSub accumulated score on various subsets of targets. A large variation of the rankings in the different subsets, indicates that the differences among the the servers are slight, and not significant in such a small subset. Hopefully, as more targets are released, some convergence may be observed. To see the detailed data of the top servers and MQAPs, click on the Subset. To see the MaxSub scores of all servers for a particular target, use the Compare facility. To see the MaxSub scores of all MQAPs for a particular target, use the MQAP results page. Meta-predictors are shown in italics , autonomous servers in normal font, and MQAPs in uppercase. Some of the latest tables were generated using the interactive results facilty.


Date Subset Gold Silver Bronze
Aug. 23 7 targets
shub
mgenthreader
3djuryC1
3djuryA1
3djuryB1
Aug. 23 11 targets
3djuryA1
ffas03
ffas04
inbgu
3ds3
Aug. 24 14 targets
3djuryA1
ffas03
mbam
pmodel4
ffas04
3ds3
3b3f
Aug. 25 15 targets
MQAP VICTOR.1
3djuryA1
protinfocm
ace
MQAP CONS.1
ffas03
pmodel4
Aug. 25 7 HM targets
MQAP VICTOR.1
sparks
MQAP CONS.1
inub
MQAP SOLVX.1
pmodel4
3djuryA1
Aug. 25 7 FR targets
3djuryB0
CAFASP-CONSENSUS
3djuryC0
3djuryB1
3djuryA1
3b3f
protinfocm
3djuryA0
MQAP VICTOR.1
Aug. 30 8 HM targets
inub
3djuryA1
ffas03
ace
shub
Sep. 7 9 HM targets
inub
3djuryA1
3djuryC1
ffas03
3djuryB1
ace
MQAP VICTOR.1
Sep. 23 8 FR targets
3djuryB0
3djuryC0
CAFASP-CONSENSUS
3djuryB1
3b3f
protinfocm
3djuryA1
3djuryA0
MQAP VICTOR.1
3djuryC1
3db3
Sep. 23 16 HM targets
pcons4
3djuryC1
expm
inub
3djuryB1
ffas03
ffas04
pmodel4
3djuryA1
ace
3ds3
inbgu
shgu
Sep. 29 10 FR targets
3djuryB0
3djuryC0
CAFASP-CONSENSUS
3djuryB1
protinfocm
3djuryC1
3b3f
3djuryA1
3db3
Oct. 8 All 26 targets,
best of top 5 models
MQAP-CONSENSUS
VICTOR
POTR
3djuryC0
VE3D
PROS
expm
Oct. 24 11 FR targets,
domain evaluation with MaxSubDom
3djuryB0
3djuryC0

MODCHECK
CAFASP-CONSENSUS
POTR
3djuryB1
3db3
pmodel5
Best non-metas at rank 8: bas_c mbam
Oct. 26 17 HM targets
3djuryC1
pcons4

expm
pmodel4

ffas03
3ds3
sp_3
3djuryB1
ffas04
inub
ace
spk2
Nov. 2 All 30 targets,
best of top 5 models ; Domain evaluation
MQAP-CONSENSUS
VICTOR
SLVX
VE3D
Best servers at rank 5: 3djuryC0 robetta
Nov. 3 19 HM targets
3djuryC1
pcons4

sp_3
expm
inub
pmodel4
ffas03
3ds3
spk2
3djuryB1
ffas04
Best MQAP at rank 4: MQAP-CONSENSUS
Nov. 3 19 HM targets
TM evaluation
3djuryC1
3ds3

sp_3
spk2
expm
3djuryB1
shgu
pmodel4
ffas03
MQAP-CONSENSUS
VICTOR
Nov. 9 All 31 targets
MaxSubDom
3djuryB1
3djuryC1
3djuryC0
3ds3
3djuryA1
CAFASP-CONSENSUS
expm
Best MQAP at rank 5: VICTOR
Nov. 10 12 FR targets,
domain evaluation with MaxSubDom
3djuryB0
3djuryC0

MODCHECK
3ds3
3djuryB1
CAFASP-CONSENSUS
POTR
3b3f
Nov. 11 All 26 non-canceled targets
MaxSubDom
3djuryC0
3djuryB1
3djuryC1
3djuryB0
expm
shub
CAFASP-CONSENSUS
3db3
Best MQAP at rank 6: VICTOR
Nov. 16 13 FR targets,
MaxSubDom
3djuryC0
3djuryB0
3db3

CAFASP-CONSENSUS
MODCHECK
3djuryB1
pmodel5
3b3f
Best non-meta at rank 5: expm
Nov. 16 22 HM targets
3djuryC1
expm
ffas04
3ds3
pcons4
MQAP-CONSENSUS
Nov. 16 All 35 targets
MaxSubDom
3djuryC1
3djuryB1
3djuryC0
expm
3ds3
3djuryB0
CAFASP-CONSENSUS
Best MQAP at rank 5: VICTOR
Nov. 22 34 HM targets,
MaxSubDom
3djuryC1
expm
3djuryC0
CAFASP-CONSENSUS
inub
bnmx
shgu
3ds3
VICTOR
3djuryB1
spk2
Nov. 22 36 FR targets,
MaxSubDom
3djuryC0
CAFASP-CONSENSUS
3djurys: A1 C1 B0
Best non-meta at rank 4: sfst
Best MQAP at rank 6: VERIFY3D

To obtain your own ranking along those of some other human predictors, as compared to the CAFASP results, send me a message to dfischer@cs.bgu.ac.il, with your number-1 models attached.


several