Some notes about the methodology
1. All settings are set to maximum rather than default. Most users do not do this, because it will result in excessive false positives (particularly for antivir). Nevertheless this is a common enough for such tests. For example av-comparatives does so.
2. More serious is this part
"The 246705 virus samples were chosen using VS2000 according to Kaspersky, F-Prot, Nod32, Dr.Web, BitDefender and McAfee antivirus programs. Each virus sample was unique by virus name, meaning that AT LEAST 1 antivirus program detected it as a new virus."
Getting a good test bed that includes real threats (which excludes rubbish files, corrupted files etc) is always the biggest challenge for a good test and pretty much every tester has test-beds that are not as good as they wish. However, to rely on antiviruses to determine if something is a threat or not obviously biases the test.
Kaspersky etc obviously have a *big* advantage in this test. After all part of the "questions" in the test are drawn from what Kaspersky knows. Kaspersky also has the biggest database (unknown though how much in there is really malicious)
See other criticism of the methodology.
Still for what's it worth, see the results below.
Results below courtesy of Virus.gr
Rank
1. G DATA 2008 version 18.2.7310.844 - 99.05%
2. F-Secure 2008 version 8.00.103 - 98.75%
3. TrustPort version 2.8.0.1835 - 98.06%
4. Kaspersky version 8.0.0.357 - 97.95%
5. eScan version 9.0.742.1 - 97.44%
6. The Shield 2008 - 97.43%
7. AntiVir version 8.1.00.331 Premium - 97.13%
8. Ashampoo version 1.61 - 97.09%
9. Ikarus version 1.0.82 - 96.05%
10. AntiVir version 8.1.00.295 Classic - 95.54%
11. AVG version 8.0.100 Free - 94.85%
12. BitDefender 2008 version 11.0.16 - 94.70%
13. Avast version 4.8.1201 Professional - 93.78%
14. Nod32 version 3.0.650.0 - 93.36%
15. F-Prot version 6.0.9.1 - 91.87%
16. BitDefender version 10 Free - 91.32%
17. ArcaVir 2008 - 88.65%
18. Norman version 5.92.08 - 87.72%
19. Vba32 version 3.12.6.6 - 87.21%
20. McAfee Enterpise version 8.5.0i - 86.57%
21. McAfee version 12.0.177 - 86.39%
22. Rising AV version 20.46.52 - 85.87%
23. Norton 2008 - 83.34%
24. Dr. Web version 4.44.5 - 82.87%
25. Antiy Ghostbusters version 5.2.3 - 80.23%
26. VirusBuster version 5.002.62 - 77.19%
27. Outpost version 6.0.2294.253.0490 - 75.35%
28. V3 Internet Security version 2008.05.31.00 - 75.23%
29. ViRobot Expert version 5.5 - 74.50%
30. Virus Chaser version 5.0a - 73.65%
31. A-squared Anti-Malware version 3.5 - 71.66%
32. PC Tools version 4.0.0.26 - 69.82%
33. Trend Micro Antivirus+Antispyware 2008 version 16.10.1079 - 67.28%
34. Iolo version 4.325 - 63.98%
34. Panda 2008 version 3.01.00 - 61.41%
36. Sophos Sweep version 7.3.2 - 54.71%
37. ClamWin version 0.93 - 54.68%
38. CA Anti-Virus version 9.00.170 - 51.08%
39. Quick Heal version 9.50 - 47.97%
40. Comodo version 2.0.17.58 - 43.15%
41. Trojan Hunter version 5.0.962 - 31.39%
42. Solo version 7.0 - 21.10%
43. Protector Plus version 8.0.C03 - 20.14%
44. PCClear version 1.0.8.0 - 19.63%
45. AntiTrojan Shield version 2.1.0.14 - 14.74%
46. Trojan Remover version 6.6.9 - 13.49%
47. VirIT version 6.2.94 - 8.63%
48. True Sword version 4.2 - 3.42%
49. Abacre έκδοση version 1.4 - 0.00%
The results look somewhat reasonable in that the top 3 are mult-engine products hence they are expect to do best. eScan uses Kaspersky's engine so you expect similar results etc. No idea what "the shield" is, but it is probably a kaspersky clone too. See remarks above about Kaspersky having a big advantage.
AntiVir premimum does better than antivir free which makes sense because of the lack of antispyware signatures. Also notice that the top 3 free antiviruses (avast! professional is exactly the same in terms of detection rates as avast! free) , antivir, avg and avast! are pretty much neck to neck.
Posts
No comments:
Post a Comment