NSS Labs Announces 2016 NGFW Group Test Results

Overall Security Effectiveness Ranged From 58.1% to 99.6%.


AUSTIN, TX--(Marketwired - Feb 29, 2016) - NSS Labs, the world's leading information security research and advisory company, today released its latest next generation firewall (NGFW) Security Value Map™ (SVM) and Comparative Analysis Report series, evaluating 13 leading NGFW products for security effectiveness, performance, and total cost of ownership (TCO). These 13 products account for 96% of the NGFW market share.

The NGFW market was $4.45B in 2015, and is expected to grow to $8.55B in 2019, a CAGR of 17.7%. The combination of size, growth rate, and importance of this market space has attracted new players, including first-time entrants from Chinese firms Huawei Technologies and Hillstone Networks.

This is the first NGFW Group Test to integrate the Cyber Advanced Warning System™ (CAWS) for continuous testing during the months of December 2015 and January 2016, making it the only multi-vendor test in the world conducted with both an exhaustive exploit library and hundreds of drive-by exploits being used in active campaigns by threat actors. CAWS provided valuable insight into how products perform over time, the speed at which vendors respond to new attacks, and overall consistency of protection. Some products proved highly consistent while others did not. Daily block rates ranged from 26.9% to 100%.

This is also the first year NSS conducted research into 'street prices', capturing vendor discounts in competitive bid situations. Solution discounts ranged from 5% to 58%, while hardware-only discounts ranged from 5% to 65%.

Additional test highlights include:

  • 7 of 13 products achieved Recommended status.
  • Overall Security Effectiveness ranged from 58.1% to 99.6%.
  • CAWS live testing revealed that no single product blocked all attacks.
  • Average Total Cost of Ownership (TCO) per protected megabit per second was US$27, with individual vendor TCO ranging from US$6 to US$97.

"This year's NGFW Group Test is our largest ever," said Mike Spanbauer, Vice President, Security, Test & Advisory for NSS Labs. "Given the number of vendor participants, and integrated visibility into live threat performance, we are providing security decision makers with the most comprehensive purchase and continuous risk management insight available."

The following products were included in the 2016 NGFW Group Test:

Barracuda Networks F600.E20 v6.1.1-071
Check Point Software Technologies 13800 Next Generation Firewall Appliance vR77.20
Cisco ASA 5585-X SSP-60 v5.4.0.3
Cisco FirePOWER Appliance 8350 v5.4.0.3
Cyberoam - Cyberoam CR2500iNG-XP v10.6.3
Dell SonicWALL SuperMassive E10800 SonicOS Enhanced v6.0.1.13-177o
Forcepoint Stonesoft Next-Generation Firewall 1402 v5.8.5
Fortinet FortiGate 3200D v5.2.4, build 5069
Hillstone Networks SG-6000-E5960 v5.5 SG6000-M-2-5.5R1P2.2
Huawei Technologies USG6650 vV500R001C00SPC010T
Juniper Networks SRX5400E JUNOS Software Release v12.3X48
Palo Alto Networks PA-7050 v6.0.11-h1
WatchGuard Technologies XTM 1525 v11.9.4 build 486684

A free copy of the SVM graphic can be downloaded at the NSS Labs website. The NGFW individual test reports, SVM Report and Comparative Analysis Report series can be found here.

About NSS Labs, Inc.
NSS Labs, Inc. is the global leader in security product testing and advisory services, providing businesses with the objective information, analysis, and tools they need to successfully manage cyber security risk. NSS offers advanced solutions including the Cyber Advanced Warning System (CAWS) -- a cloud service that continuously captures live attacks being used by threat actors, and tests security products against those attacks in real time. CEOs, CIOs, CISOs, and information security professionals from many of the world's largest and most demanding enterprises rely on insight from NSS. For more information, visit www.nsslabs.com.

Contact Information:

Contact:
Tom Resau
W2 Communications
Phone: +1 (703) 877-8103
tom@w2comm.com