Skip to content

Competitive Benchmarks

Why Trend Micro outperforms the competition

Traditionally, benchmark performance tests used a set of known malware files during a closed test. However, this type of testing does not take into account how threats typically propagate.

With new threats being introdcued every 1.5 seconds, vendors have to be able to quickly respond to new attacks which they cannot block. Newer test methodologies emulate real-world scenarios to show how quickly a vendor can source, analyze and add protection for unknown threats.

Trend Micro has outperformed the competition in a number of recent tests by NSS Labs, Dennis Technology Labs, and AV-Test.org due to the Smart Protection Network™ infrastructure that powers our products.

This unique cloud-client architecture uses Smart Feedback to source new potential threats, patent-pending correlation to analyze multiple threat vectors in real-time, and in-the-cloud reputation databases to deliver protection wherever our customers connect, all of which allows Trend Micro to respond faster than other vendors.

Our cloud-based protection network is the most evolved and comprehensive network in the industry blocking billions of email, web and file-based threats daily.


 Testing companies

AV-test.org

AV-Test GmbH is a leading worldwide service provider for IT security testing and consultancy services. Their team has more than 15 years of experience in the area of antivirus research and data security. Every year they perform more than 2,500 product tests of antivirus, antispyware, personal firewalls and related products on behalf of vendors, integrators (OEM), corporate users and magazines.

Dennis Technology Labs

Dennis Technology Labs is an independent testing facility that evaluates personal and business technology, including hardware and software. They specialize in security testing and have developed one of the few real-world tests within our industry that gives users a good view of the efficacy of the solutions against today’s threats. Using a world-class anti-malware testing framework, they work with businesses, technology vendors and magazines to provide accurate and realistic test results that are useful to consumers and vendors' internal teams.

NSS Labs

NSS Labs is the leading independent security product testing organization, and operates the largest security and performance lab in the world. NSS Labs is independent, and does not have a parent company that competes with product vendors or sells advertising. Their test reports are highly regarded by information security professionals for their rigor, depth and integrity, and are used to validate purchasing decisions in global enterprises.

Read analyst brief on the need for new testing methods (PDF)

Trend Micro Anti-Spam beats field in Opus1 December Test

Trend Micro took on 8 other anti-spam products from Gartner’s Magic Quadrant Leaders/Challengers list in a commissioned test by Opus1 in December 2011.

Download report

Who was Tested

Opus1 tested 9 vendor solutions in an anti-spam test performed for Trend Micro in December 2011. The vendors were selected based on the 2011 Gartner Magic Quadrant report for Secure Email Gateways and represented vendors in the Leader/Challenger categories. The 9 vendors are: Barracuda Networks, Cisco, Google, McAfee, Microsoft, Proofpoint, Sophos, Symantec, and Trend Micro.

Powered by the Trend Micro Smart Protection Network™ and Email reputation, our messaging solutions deliver superior results for customers.

Results

Antispam-testing-results-2011

Source: Opus1

Check out our Small Business anti-spam solutions here

Check out our Enterprise Messaging solutions here

OfficeScan beats McAfee, Microsoft, Sophos, Symantec AV-Test.org May 2011

For the twelfth straight month, OfficeScan has outperformed its peer competitive products in overall results, exposure layer results and time to protect results.

As important, the time to protect against unknown threats was four times faster than the nearest competitor. With the average time to protect of almost two days by all competitors, Trend averaged less than five hours!

Request the Q2 2010 endpoint protection product group test report directly from NSS Labs.

Test methodology

NSS Labs sourced real socially-engineered malware on the Internet and tested each solution in a real-world online computing environment. They measured whether each solution could block the threat at its source or during download (caught initially on download), or when the threat executed on the machine (caught subsequently on execution).

The labs conducted independent testing on endpoint products from leading security vendors to reveal the highest levels of socially-engineered malware protection. The testing was unsponsored and non-commissioned.

Results

Officescan-nss-labs-overall-results

Source: NSS Labs Q2 2010 Enterprise Endpoint Group Test – Host Intrusion Prevention

Trend Micro Deep Security uses the same technology as that used in OfficeScan’s Intrusion Defense Firewall (IDF) plug-in to ensure corporate servers are protected from exploits.

Learn more about OfficeScan and IDF or Deep Security.

OfficeScan ranks #1 against nine competitors NSS Labs June 2010

OfficeScan ranked #1 for the second time in NSS Labs independent test of corporate endpoint solutions, providing the best overall ability to keep malicious threats off the network and the machine.

Worry-Free Business Security outperforms four market-leading SMB solutions May 2011

In May 2011, AV-Test.org performed endpoint security benchmark testing on five market-leading SMB endpoint solutions from Symantec, McAfee, Sophos, ESET, Kaspersky, and Trend Micro.

Worry-Free Business Security outperformed its peer competitive products in the overall results and Exposure Layer results.

Download report (PDF)

Test methodology

AV.org’s methodology uses samples that are malicious URLs with associated malware files and allows the solutions to block threats at their source (Exposure Layer), during download (Infection Layer) or on execution (Dynamic Layer).

They also test the ability to source, analyze and protect against any samples that went undetected during the first round by re-testing one hour later.

Results

Worry-free-av-test-overall-results

Source: AV-Test.org | Note: Results are based on the T+60 minute results

Officescan-av-test-time-to-protect

Source: AV-Test.org | NOTE: Time-to-protect improvement is the percentage of threats missed at T=0min that are subsequently prevented at T=60min. For example, with Trend Micro Worry-Free Business Security: At T=0min, 190 threats were prevented while 10 threats were missed. Of the 10 threats missed at T=0min, 1 was prevented at T=60min (1 of 10 equals 10%).

Learn more about Worry-Free Business Security Standard

Titanium Maximum Security maintains top ranking against ten others NSS Labs September 2010

For the second time in NSS Labs’ independent anti-malware tests of consumer endpoint products Trend Micro ranked #1 in overall protection, blocking on download and time to protect.

Nss-labs-recommendedThese results reflect the effectiveness of the Trend Micro Smart Protection Network™ which powers all of our endpoint solutions and provides the best protection against Internet-based malware as well as the fastest time to protect against unknown threats.

Dowload the Q3 consumer anti-malware group test (PDF) report directly from NSS Labs

 

Test methodology

NSS Labs tested live, Internet-based malware over 11 days. Every six hours they tested new threats as well as missed threats to identify how effectively products performed against live threats.

By testing multiple layers of protection, blocking the source (A), blocking on download (B), and blocking upon execution (C), the NSS Labs test mimic’s real-world computing scenarios and provides a better way for consumers to identify the product that offers the best protection.

Results

Titanium-nss-labs-overall-results

Source: NSS Labs consumer anti-malware group test, Q3 2010

Titanium-nss-labs-time-to-protect

Source: NSS Labs consumer anti-malware group test, Q3 2010

Learn more about Titanium Maximum Security

Titanium Maximum Security earns top marks Dennis Technology Labs January 2011

In benchmark testing of eleven market-leading consumer endpoint solutions, Titanium Maximum Security performed better than most of its competitors and tied with Symantec in total accuracy.

The popular antivirus programs compared for effectiveness included:

  • Avira Premium Security Suite 2011
  • ESET Smart Security 4
  • G Data TotalCare/InternetSecurity 2011
  • McAfee Total Protection/Internet Security 2011
  • Symantec Norton 360 v5/Internet Security 2011
  • Webroot Internet Security Complete 2011
  • BitDefender Total Security/Internet Security 2011
  • F-Secure Internet Security 2011
  • Kaspersky PURE/Internet Security 2011
  • Panda Global Protection/Internet Security 2011
  • Trend Micro Titanium Maximum Security/Internet Security 2011

Download the PC total protection suites 2011 (PDF) report, commissioned by Symantec, directly from Dennis Technology Labs

Testing methodology

Products were exposed to genuine internet threats that real customers could have encountered during the test period. Crucially, this exposure was carried out in a realistic way, reflecting a customer’s experience as closely as possible.

For example, each test system visited genuinely infected websites and downloaded pages, exploits and malicious files exactly as an average user would. DTL also tested how each product handled legitimate applications. These were downloaded from Download.com or the original site as directed by Download.com.

The popularity of each program was taken into account. Products are awarded marks for detecting real threats and providing adequate protection. Points are deducted for failing to protect the system and for falsely condemning legitimate software.

Results

Titanium-dennis-labs-total-accuracy-scores

Source: Dennis Technology Labs — January 2011

Titanium-dennis-labs-protection-details

Source: Dennis Technology Labs — January 2011

Why does Trend Micro consistently perform Well in real-world tests?

To overcome the limitations of outdated benchmark practices, Trend Micro has been commissioning AV-Test.org monthly to use a real-world testing methodology in which the samples are malicious URLs with associated malware files.

The tests measure how well the solutions block threats at their source (Exposure Layer), during download (Infection Layer) or upon execution (Dynamic Layer).

They also test the product’s ability to source, analyze and protect against any samples that went undetected during the first round by re-testing one hour later.

Over time, it has become apparent that Trend Micro’s multi-layered approach based on the cloud-based Smart Protection Network consistently blocks real-world threats more effectively than its competitors.

Av-test-historical-results

Source: AV-Test.org | Total percentage of all threats blocked at each layer: Exposure, Infection and Dynamic. Note: Results are based on the T=0 minute results. Test results can vary over time and may vary with other configuration settings.

Consistency in real-world tests may be compromised due to the following:

  1. Vendor is still focused on file-based protection which is difficult to keep updated with the number of new threats being released each hour.
  2. Vendor does not provide blocking of malicious URLs, which is the source of most infections today.
  3. Vendor does not have automated sourcing of unknown threats.
  4. Vendor does not have automatic correlation of new threat data in order to quickly identify unknown threats
  5. Vendor does not have cloud-based protection and still requires signature files to be delivered to each and every endpoint computer, thus delaying the time to protect.

 

Archive

 


Social Media

Connect with us on