Intel's SPDK Transition to the Linux Foundation
Intel is pleased to announce that the Storage Performance Development Kit (SPDK) project will be transitioning to the Linux Foundation in 2025. This move aims to ensure the long-term sustainability and growth of SPDK, fostering a vibrant community and driving innovation in storage performance.
Continue...SPDK v24.09: fsdev, NVMe-oF TCP interrupt mode
On behalf of the SPDK community, I’m proud to announce the release of SPDK v24.09!
Continue...24.05 SPDK NVMe-oF RDMA and Vhost Performance Reports
The performance reports for SPDK 24.05 have been published. One report presents the results for RDMA NVMe-oF, utilizing the Intel E810-CQDA2 NIC with RoCEv2 protocol enabled in the hardware setup. The other report covers the Vhost performance results.
Continue...2024 SPDK Developer Meetup Hosted by Intel
This year Intel hosted the 4th SPDK Developer Meetup in Gdansk, Poland. The event was a great success, attracting around 30 attendees from 7 different companies. The agenda was packed with a variety of activities, including technical presentations, open discussions, and collaborative whiteboard design work. Attendees had the opportunity to network, learn, and contribute to the growth of the SPDK community.
Continue...24.05 SPDK NVMe-oF TCP Performance Reports
SPDK TCP NVMe-oF 24.05 performance report documents have been published. Report documents contain results of benchmark tests carried out using two different NICs:
Continue...24.05 SPDK NVMe Bdev and NVMe-oF RDMA Performance Reports
Another part of SPDK 24.05 performance report documents is now available.
Continue...24.05 SPDK NVMe Bdev Performance Report
The first part of the SPDK 24.05 performance report documents is now available.
Continue...SPDK v24.05: NVMe in-band authentication, keyring lib, blob shallow copy
On behalf of the SPDK community I’m pleased to announce the release of SPDK 24.05!!
Continue...Introducing aRFS insights to our 24.01 NVMe-oF TCP performance reports
We would like to announce the integration of Accelerated Receive Flow Steering (aRFS) results into our 24.01 SPDK TCP NVMe-oF 24.01 performance report document (Mellanox ConnectX-5 Ex version). We have added data showcasing aRFS’s impact on NVMe-oF TCP performance - throughput, latency and CPU utilization.
Continue...24.01 SPDK NVMe-oF RDMA Performance Report
SPDK RDMA NVMe-oF 24.01 performance report document has been published. This report presents performance results using Intel E810-CQDA2 NIC with RoCEv2 protocol enabled in the hardware setup.
Continue...24.01 SPDK Vhost Performance Report
SPDK 24.01 Vhost performance report document has been published.
Continue...Announcing the 2024 SPDK Developer Meetup Hosted by Intel
Come and join us for the 4th SPDK Developer Meetup, hosted by Intel in the picturesque city of Gdansk, Poland!
Continue...24.01 SPDK NVMe-oF TCP Performance Reports
SPDK TCP NVMe-oF 24.01 performance report documents have been published. Report documents contain results of benchmark tests carried out using two different NICs:
Continue...24.01 SPDK NVMe Bdev and NVMe-oF RDMA Performance Reports
First part of SPDK 24.01 performance report documents is now available.
Continue...raid5f: the SPDK RAID 5 implementation
RAID 5 is a popular RAID level which, similarly to RAID 1 (mirroring), protects data in the array against failure of a member drive and can improve read performance by reading from multiple drives in parallel. It is often preferred over mirroring because it “wastes” less storage capacity - the array can have many member drives but the total available capacity is always reduced only by the size of one member. Meanwhile, RAID 1 exposes the capacity of only one member. That’s 50% in the most common two-way mirror case, which provides the same level of protection as RAID 5 - protection from failure of one drive.
Continue...SPDK v24.01: DIF in accel, RAID rebuild, Blobstore grow
On behalf of the SPDK community I’m pleased to announce the release of SPDK 24.01 LTS!! The SPDK 24.01 release is a long term support release that will be supported for 1 year.
Continue...23.09 SPDK NVMe-oF TCP Performance Reports
SPDK TCP NVMe-oF 23.09 performance report documents have been published. Report documents contain results of benchmark tests carried out using two different NICs:
Continue...23.09 SPDK Vhost Performance Report
SPDK 23.09 Vhost performance report document has been published.
Continue...23.09 SPDK NVMe-oF RDMA Performance Reports
SPDK RDMA NVMe-oF 23.09 performance report documents have been published. Report documents come in different flavors, using different NICs and protocols for NVMe-oF target to NVMe-oF initiator connections:
Continue...23.09 SPDK NVMe Bdev Performance Report
SPDK 23.09 performance report document for SPDK NVMe Bdev has been published.
Continue...SPDK v23.09: NVMe-oF TCP data digest chaining, JSON-RPC Go client, DIF/DIX CRC32/64
On behalf of the SPDK community I’m pleased to announce the release of SPDK 23.09!!
Continue...23.05 SPDK Vhost Performance Report
SPDK 23.05 performance report document for SPDK Vhost has been published.
Continue...23.05 SPDK NVMe-oF TCP Performance Reports
SPDK TCP NVMe-oF 23.05 performance report documents have been published. Report documents contain results of benchmark tests carried out using two different NICs:
Continue...23.05 SPDK NVMe-oF RDMA Intel E810 RoCEv2 Performance Report
SPDK RDMA NVMe-oF 23.05 performance report document has been published. This report presents performance results using Intel E810-CQDA2 NIC with RoCEv2 protocol enabled in the hardware setup.
Continue...23.05 SPDK NVMe-oF RDMA Performance Reports
SPDK RDMA NVMe-oF 23.05 performance report documents have been published. Report documents come in different flavors, using different NICs and protocols for NVMe-oF target to NVMe-oF initiator connections:
Continue...23.05 SPDK NVMe Bdev Performance Report
SPDK 23.05 performance report document for SPDK NVMe Bdev has been published.
Continue...SPDK As IPU Firmware - Part 3
Welcome to the third and final post in our series on SPDK as IPU firmware! In part 1 we discussed the addition of memory domains and in part 2 we focused on avoiding data copies for crypto and on address translation. So let’s pick up from there.
Continue...SPDK v23.05: NVMe-oF/TCP TLS, Logical Volume External Snapshots
On behalf of the SPDK community I’m pleased to announce the release of SPDK v23.05!
Continue...SPDK As IPU Firmware - Part 2
Welcome to the second post in our series on SPDK as IPU firmware. The previous post laid the groundwork for using SPDK on an IPU. Now we’re going to focus on enabling inline, block-level encryption in a more efficient way. If it isn’t fresh in your mind, take a moment to review our example scenario from the last post. We’ll start from there.
Continue...SPDK v23.01.1: Maintenance Release
On behalf of the SPDK community I’m pleased to announce the release of SPDK v23.01.1.
Continue...Fuzz testing SPDK
Fuzzing is a software testing technique that incorporates feeding random, unexpected input to a computer program to test unexpected paths of software execution. The SPDK project uses two approaches to fuzz testing:
Continue...SPDK As IPU Firmware - Part 1
Welcome to the first post in a new series on SPDK as IPU firmware. For those not familiar with the term Infrastructure Processing Unit (IPU), these are PCIe cards attached to a host system that offload “infrastructure” work, usually for a cloud or hyper-converged service provider. In terms familiar to SPDK developers, these cards typically have some hardware that’s capable of presenting what appear to be physical NVMe or virtio-blk/scsi devices to the host system, but then may forward any I/O sent to that device over the network.
Continue...23.01 SPDK NVMe-oF TCP Performance Report
SPDK TCP NVMe-oF 23.01 performance report document has been published. This report contains results of benchmark tests carried out using Intel E810-CQDA2 NICs.
Continue...23.01 SPDK NVMe-oF TCP Performance Report
SPDK TCP NVMe-oF 23.01 performance report document has been published. This report contains results of benchmark tests carried out using Mellanox ConnectX-5 Ex NICs.
Continue...ublk: the new and improved way to serve SPDK storage locally!
SPDK v23.01 added a new ublk library that can expose SPDK block devices as Linux kernel block devices using the Linux ublk framework added in the Linux 6.0 kernel. The Linux kernel doc for ublk describes ublk as:
Continue...New Core Maintainers For SPDK CSI
The SPDK project has a team of core maintainers who are responsible for providing technical oversight for the SPDK project, including final review and merging of patches into the SPDK code base. As the SPDK project continues to grow, the core maintainer team also needs to grow by adding contributors who are already demonstrating technical skill and leadership within the project. SPDK has seen increased interest in orchestration, especially the SPDK CSI Kubernetes plugin, so we are pleased to announce that Yibo Cai and Antti Kervinen are joining the core maintainer team with a specific focus on the spdk-csi project. Yibo and Antti will be responsible for helping define and refine the architecture and design for spdk-csi, as well as being primary reviewers for all incoming patches.
Continue...23.01 SPDK NVMe-oF RDMA Performance Reports
SPDK RDMA NVMe-oF 23.01 performance report documents have been published. Report documents come in different flavors, using different NICs and protocols for NVMe-oF target to NVMe-oF initiator connections:
Continue...23.01 SPDK NVMe Bdev & Vhost Performance Reports
SPDK 23.01 performance report documents for SPDK NVMe Bdev and SPDK Vhost have been published.
Continue...120 Million I/O Per Second with a Standard 2U Intel® Xeon® System
In 2013, Intel started the Storage Performance Development Kit (SPDK) project to reimagine the storage software stack. Although NVMe was still in its infancy, organizations integrating NVMe SSDs recognized the challenges they faced as the performance and efficiency of the storage software became increasingly critical to overall system performance. When Intel kicked off the SPDK Open-Source Community in 2015, a global phenomenon was born that was laser-focused on demonstrating the outstanding performance and efficiency enabled by running software designed for NVMe devices. In the beginning, the community demonstrated that it’s possible to build systems capable of millions of IOPS (I/O operations per second) using standard hardware. However, when solid-state media based on technologies like the Intel® Optane™ arrived, a whole new class of NVMe SSDs with higher throughput and an order of magnitude reduction in hardware latency the community saw an opportunity to redesign the SPDK NVMe driver. In 2019, a new SPDK NVMe driver capable of over 10 million IOPS (using a single CPU core!) was released and accompanied by a blog with deep technical insights on the techniques SPDK employs to achieved great performance. But the SPDK community is about both performance and scalability, so in 2021 we demonstrated a system that scaled to 80 million IOPS. We’re kicking off 2023 with another mind-blowing accomplishment.
Continue...SPDK v23.01: accel chained ops, accel crypto, ublk target
On behalf of the SPDK community I’m pleased to announce the release of SPDK 23.01 LTS!! The SPDK 23.01 release is a long term support release that will be supported for 1 year.
Continue...Presentations: SPDK PRC Virtual Forum on Dec 21-22, 2022
Thank you all for attending the SPDK PRC Virtual Forum. We had a very successful Virtual Forum this year with awesome content and presenters. You can download the presentations using the links below. Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation.
Continue...SPDK Spinlocks Introduction
The recently introduced spdk_spinlock
offers safety and debugging improvements
over pthread_mutex_t
.
Announcing The 2022 PRC SPDK Virtual Forum!
Save The Date
Continue...22.09 SPDK NVMe-oF RDMA Performance Report
SPDK RDMA NVMe-oF 22.09 performance report document has been published. This report document version uses Mellanox ConnectX-5 Ex NICs for NVMe-oF target to NVMe-oF initiator connections.
Continue...Tracing Framework Guide Part 2
Introduction
Continue...SPDK v22.01.2: Maintenance Release
On behalf of the SPDK community I’m pleased to announce the release of SPDK 22.01.2 LTS. Due to DPDK vhost CVE fixes users are strongly encouraged to upgrade.
Continue...Presentations: SPDK Virtual Forum on Nov 15-16, 2022
Thank you all for attending the SPDK Virtual Forum. We had a very successful Virtual Forum this year with awesome content and presenters. You can download the presentations using the links below. Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation.
Continue...22.09 SPDK NVMe-oF TCP Performance Reports
SPDK TCP NVMe-oF 22.09 performance report documents have been published. This time the report comes in two flavors, using different NICs for NVMe-oF target to NVMe-oF initiator connections:
Continue...22.09 SPDK NVMe Bdev & Vhost Performance Reports
SPDK 22.09 performance report documents for SPDK NVMe Bdev and SPDK Vhost have been published.
Continue...Announcing The 2022 US SPDK Virtual Forum!
Save The Date
Continue...SPDK v22.09: FTL, xNVMe bdev, DAOS bdev, SMA crypto and QoS
On behalf of the SPDK community I’m pleased to announce the release of SPDK 22.09!!
Continue...Tracing Framework Guide Part 1
Introduction
Continue...22.05 SPDK NVMe Bdev Performance Report
Performance report document for SPDK NVMe Bdev 22.05 release has been published.
Continue...SPDK v22.05: SMA, accel_fw IAA, virtio-blk transport abstraction
On behalf of the SPDK community I’m pleased to announce the release of SPDK 22.05!!
Continue...SPDK v22.01.1: Maintenance Releases
On behalf of the SPDK community I’m pleased to announce the release of SPDK 22.01.1 LTS. Due to DPDK vhost CVE fixes users are strongly encouraged to upgrade.
Continue...22.01 SPDK NVMe Bdev PCIe Gen4 Performance Report
New version of 22.01 SPDK NVMe Bdev performance report document has been published. Updated version presents performance results measured using new PCIe Gen4 platform: Supermicro SYS-220U-TNR with Intel(R) Xeon(R) Gold 6348 Ice Lake and twenty two Kioxia(R) KCM61VUL3T20 Gen4 NVMe drives.
Continue...22.01 SPDK Vhost Performance Report - vfio-user update
SPDK Vhost 22.01 performance report document has been updated with Vfio-User update.
Continue...Announcing SPDK 2022 Hackathon
We are excited to announce the SPDK Community Hackathon will be held virtually on April 28th,2022 8am to 12:30pm PDT. Hackathon will be focused on NVMe vfio-user - Overview of the architecture, its threat model, and how to improve and extend testing (including fuzzing) of the SPDK nvme vfio-user target stack. REGISTER today to collaborate with other community developers for technical and interactive discussions.
Continue...22.01 SPDK NVMe Bdev & NVMe-oF RDMA Performance Reports
SPDK NVMe Bdev and NVMe-oF RDMA 22.01 performance report documents have been published.
Continue...22.01 SPDK NVMe-oF TCP & Vhost Performance Reports
SPDK TCP NVMe-oF and SPDK Vhost 22.01 performance report documents have been published.
Continue...SPDK v22.01: NVMe multipath, NVMe TCP zero-copy, NVMe-oF discovery service
On behalf of the SPDK community I’m pleased to announce the release of SPDK 22.01 LTS!! The SPDK 22.01 release is a long term support release that will be supported for 1 year.
Continue...Tracing Framework
Introduction
Continue...SPDK Performance Regression Test Dashboards
SPDK Continuous Integration system provides functional test results for patches submitted at https://review.spdk.io. These tests however, do not provide information about the impact of submitted changes on SPDK's overall performance. Because of that, we decided to make performance regression test results available for the community. The tests are scheduled to run roughly every two hours using the most recent SPDK code base available on master branch. Result are presented using Grafana dashboards containing information about IOPS, Bandwidth and Latency (along with visual representation) are available on https://performance.spdk.io.
Continue...Presentations: SPDK, PMDK and Intel® Performance Analyzers PRC Online Forum on December 15, 2021
Thank you all for attending the SPDK, PMDK and Intel® Performance Analyzers PRC Online Forum. We had a very successful Online Forum this year with awesome content and presenters. You can download the presentations using the links below. Please note these are static PDFs, but some of the presentations made use of animations, so something may be lost in translation.
Continue...New Core Maintainer - Konrad Sztyber
The SPDK project has a team of core maintainers who are responsible for providing technical oversight for the SPDK project, including final review and merging of patches into the SPDK code base. As the SPDK project continues to grow, the core maintainer team also needs to grow by adding contributors who are already demonstrating technical skill and leadership within the project. So we are pleased to announce that we are adding Konrad Sztyber to the core maintainer team!
Continue...21.10 SPDK NVMe Bdev Performance report
Performance report document for SPDK NVMe Bdev 21.10 release has been published.
Continue...21.10 SPDK NVMe-oF TCP Performance report
Performance report document for SPDK NVMe-oF TCP 21.10 release has been published.
Continue...21.10 SPDK NVMe-oF RDMA Performance report
Performance report document for SPDK NVMe-oF RDMA 21.10 release has been published.
Continue...21.10 SPDK Vhost Performance report
Performance report document for SPDK Vhost 21.10 release has been published.
Continue...SPDK v21.10: DMA lib, Async NVMe driver, Container scripts
On behalf of the SPDK community I’m pleased to announce the release of SPDK 21.10!!
Continue...BPF tracing with SPDK
Recently, in the v21.07 release, SPDK got
support for BPF tracing. It consists of a set of scripts and static probes defined within the SPDK
libraries giving the user yet another way to inspect SPDK-based applications. SPDK already had a
tracing library, called libtrace
, for a long time. BPF tracing isn’t supposed to replace it, but
rather complement it. Both have slightly different capabilities - libtrace
has significantly
lower overhead, but is less flexible. BPF traces, on the other hand, are more costly (they require
a kernel trap), but are more robust and can even be attached dynamically, without having to define
the probes in code.
21.07 SPDK NVMe Bdev Performance report
Performance report document for SPDK NVMe Bdev 21.07 release has been published.
Continue...21.07 SPDK NVMe-oF TCP Performance report
Performance report document for SPDK NVMe-oF TCP 21.07 release has been published.
Continue...21.07 SPDK NVMe-oF RDMA Performance report
Performance report document for SPDK NVMe-oF RDMA 21.07 release has been published.
Continue...21.07 SPDK Vhost Performance report
Performance report document for SPDK Vhost 21.07 release has been published.
Continue...SPDK v21.07: Kernel DSA, Init lib, Userspace DTrace
On behalf of the SPDK community I’m pleased to announce the release of SPDK 21.07!!
Continue...21.04 SPDK Performance reports
Performance report documents for SPDK 21.04 release have been published.
Continue...Presentations: SPDK, PMDK and Intel® VTune™ Amplifier Virtual Forum on June 22-24, 2021
Thank you all for attending the SPDK, PMDK and Intel® Performance Analyzers Virtual Forum. We had a very successful Virtual Forum this year with awesome content and presenters. You can download the presentations using the links below. Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation.
Continue...Announcing The 2021 US SPDK, PMDK and Intel® Performance Analyzers Virtual Forum!
Save The Date
Continue...What? 80 Million I/O Per Second with a Standard 2U Intel® Xeon® System!
The adoption of NVM Express® SSDs in the data center is unleashing performance that was unprecedented just a few years ago. Since the inception of the SPDK project, the community has demonstrated that it’s possible to build systems capable of tens of millions of IOPS (I/O operations per second) using commodity hardware. Over the last couple of years, we have demonstrated systems capable of over 10 million IOPS (using a single CPU core!), but now we’re ready to significantly advance the state of the art. Yes, 80 Million IOPS.
Continue...VFIO-USER: A new virtualization protocol
We’re excited to announce support for NVMe over vfio-user, a technology that allows SPDK to present fully emulated NVMe devices into virtual machines. Virtual machines can leverage their existing NVMe drivers to communicate with the devices and data is transferred efficiently to or from SPDK using shared memory. In other words, just like vhost-user but able to emulate NVMe devices instead of virtio-blk or virtio-scsi devices.
Continue...SPDK v21.04: ZNS NVMe bdev, PMR, ADQ initiator, RPM
On behalf of the SPDK community I’m pleased to announce the release of SPDK 21.04!!
Continue...21.01 SPDK NVMe Bdev Performance Report
New performance report for SPDK NVMe Bdev has been published.
Continue...21.01 SPDK Vhost Performance Report
New performance report for SPDK Vhost has been published.
Continue...spdk_top - what's new in 21.01
In SPDK’s 21.01 release spdk_top
received a few improvements that we’re excited to share.
21.01 SPDK NVMe-oF TCP & RDMA Performance Reports
New performance report for SPDK NVMe-oF TCP and SPDK NVMe-oF RDMA have been published.
Continue...Introducing the SPDK symbol
We’re excited to announce that SPDK has its very own symbol:
Continue...SPDK on Windows (Experimental)
Yes, it really does say Windows and SPDK in the same sentence! It is now possible to experiment with SPDK on Windows.
Continue...SPDK v21.01.1: Maintenance Releases
On behalf of the SPDK community I’m pleased to announce the release of SPDK 21.01.1 LTS.
Continue...SPDK v21.01 LTS: Dynamic scheduler, vfio-user, ZNS Zone Append
On behalf of the SPDK community I’m pleased to announce the release of SPDK 21.01 LTS!!
Continue...20.10 SPDK NVMe Bdev Performance Report
New performance report for SPDK NVMe Bdev has been published.
Continue...20.10 SPDK NVMe-oF RDMA Performance Report
New performance report for SPDK NVMe-OF RDMA has been published.
Continue...20.10 SPDK NVMe-oF TCP Performance Report
New performance report for SPDK NVMe-OF TCP has been published.
Continue...20.10 SPDK Vhost Performance Report
New performance report for SPDK Vhost has been published.
Continue...Presentations: 2020 PRC SPDK, PMDK and Intel® VTune™ Profiler Virtual Forum on November 14, 2020
Thank you all for attending the 2020 PRC SPDK, PMDK and Intel® VTune™ Profiler Virtual Forum. We had a very successful Virtual Forum this year with awesome content and presenters. You can download the presentations using the links below. Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation.
Continue...SPDK v20.10: NVMe-oF multipath, NVMe ZNS, iSCSI login redirection
On behalf of the SPDK community I’m pleased to announce the release of SPDK 20.10!
Continue...Announcing The 2020 PRC SPDK, PMDK and VTune Virtual Forum!
Save The Date
2020 Storage Performance Development Kit (SPDK), Persistent Memory Development Kit (PMDK) and Intel® Vtune Amplifier Virtual Forum
November 14th
20.07 SPDK NVMe-oF TCP Performance Report
New performance report for SPDK NVMe-oF TCP has been published.
Continue...Recent Technical Whitepapers Referencing SPDK
Several companies have recently published whitepapers referencing SPDK.
Continue...20.07 SPDK NVMe-oF RDMA Performance Report
New performance report for SPDK NVMe-oF RDMA has been published.
Continue...20.07 SPDK Vhost Performance Report
New performance report for SPDK Vhost has been published.
Continue...SPDK v20.07: SPDK CSI driver, new accel_fw commands, I/O abort support
On behalf of the SPDK community I’m pleased to announce the release of SPDK 20.07!
Continue...Presentations: SPDK, PMDK and Intel® VTune™ Amplifier Virtual Forum on June 23-25, 2020
Thank you all for attending the SPDK, PMDK and Intel® VTune™ Amplifier Virtual Forum. We had a very successful Virtual Forum this year with awesome content and presenters. You can download the presentations using the links below. Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation.
Continue...20.04 SPDK NVMe-oF RDMA Performance Report
New performance report for SPDK NVMe-oF has been published.
Continue...20.04 SPDK Vhost Performance Report
New performance report for SPDK Vhost has been published.
Continue...20.01 SPDK NVMe-oF RDMA Performance Report
New performance report for SPDK NVMe-oF RDMA has been published.
Continue...20.04 SPDK NVMe-oF TCP Performance Report
New performance report for SPDK NVMe-oF TCP has been published.
Continue...SPDK v20.01.2 and v20.04.1: Maintenance Releases
On behalf of the SPDK community I’m pleased to announce the releases of SPDK 20.01.2 LTS and SPDK 20.04.1!
Continue...Announcing The 2020 US SPDK, PMDK and VTune Virtual Forum!
Save The Date
2020 Storage Performance Development Kit (SPDK), Persistent Memory Development
Kit (PMDK) and Intel® Vtune Amplifier Virtual Forum
June 23rd-25th
20.01 SPDK NVMe-oF TCP Performance Report
New performance report for SPDK NVMe-oF TCP has been published.
Continue...SPDK v20.04: SPDK Top, IDXD, NVMe qpair groups
On behalf of the SPDK community I’m pleased to announce the release of SPDK 20.04!
Continue...New spdk_top application
A new application has just joined SPDK family - spdk_top. Designed to resemble standard top, spdk_top provides additional insight into SPDK cores, lightweight threads, and pollers. Have you ever wondered which core is used most by your SPDK instance? Are you building your own bdev or library and want to know if your code is running efficiently? Are your new pollers busy most of the time? You can check that now with spdk_top and tune your implementation with the provided information to get even more from SPDK!
Continue...20.01 SPDK Vhost Performance Report
New performance report for SPDK Vhost has been published.
Continue...SPDK v20.01.1: Maintenance LTS Release
On behalf of the SPDK community I’m pleased to announce the release of SPDK 20.01.1 LTS!
Continue...Rescheduling The 2020 US SPDK, PMDK and VTune Summit!
We are rescheduling the SPDK, PMDK and VTune™ Profiler Summit for later in 2020 due to the continued concern over the spread of the coronavirus.
Continue...SPDK v20.01: Optimized thin provisioning, FTL bdev, VMD hot plug, FUSED support
On behalf of the SPDK community I’m pleased to announce the release of SPDK 20.01!
Continue...Announcing The 2020 US SPDK, PMDK and VTune Summit!
Save The Date
2020 Storage Performance Development Kit (SPDK), Persistent Memory Development
Kit (PMDK) and Intel® Vtune Amplifier Summit
April 21st-22nd
Dolce Hayes Mansion, San Jose
200 Edenvale Ave, San Jose, CA 95136
http://www.hayesmansion.com
19.10 SPDK SPDK NVMe-oF RDMA Performance Report
New performance report for SPDK NVMe-oF RDMA has been published.
Continue...SPDK v19.10.1: Maintenance Release
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.10.1!
Continue...New Core Maintainer - Alexey Marchuk
The SPDK project has a team of core maintainers who are responsible for providing technical oversight for the SPDK project, including final review and merging of patches into the SPDK code base. As the SPDK project continues to grow, the core maintainer team also needs to grow by adding contributors who are already demonstrating technical skill and leadership within the project. So I am pleased to announce that we are adding Alexey Marchuk to the core maintainer team!
Continue...19.10 SPDK SPDK NVMe-oF TCP Performance Report
New performance report for SPDK NVMe-oF TCP has been published.
Continue...19.10 SPDK Vhost Performance Report
New performance report for SPDK Vhost has been published.
Continue...SPDK v19.10: NVMe character devices, Zoned bdev API, Opal support
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.10!
Continue...19.07 SPDK NVMe-oF TCP & Vhost Performance Reports
New performance reports for SPDK NVMe-oF TCP transport and for Vhost have been published.
Continue...SPDK v19.07.1: Maintenance Release
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.07.1!
Continue...Presentations: SPDK, PMDK and Intel® VTune™ Amplifier PRC Summit on September 5-6, 2019
Thank you all for attending the SPDK, PMDK and Intel® VTune™ Amplifier PRC Summit. We had a very successful summit this year with awesome content and presenters. You can download the presentations including opening, keynotes, technical sessions and hands on labs using the links below. Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation.
Continue...Announcing the 2019 SPDK Developer Meetup Hosted by Nutanix
Come and join the 3rd annual SPDK Developer Meet-up, this year hosted by Nutanix in beautiful San Jose, CA! It’s an excellent opportunity for networking, learning, coding, and generally strengthening the community. We’ll be covering all sorts of topics so there’s sure to be something for everyone!
Continue...Announcing The PRC SPDK Summit!
Save The Date
2019 Storage Performance Development Kit (SPDK) PRC Summit
September 5th-6th
Crowne Plaza Zhongguancun, Beijing
No.106 Zhichun Road, Haidian District, Beijing
Crowne Plaza Zhongguancun
New Core Maintainer - Tomek Zawadzki
The SPDK project has a team of core maintainers who are responsible for providing technical oversight for the SPDK project, including final review and merging of patches into the SPDK code base. As the SPDK project continues to grow, the core maintainer team also needs to grow by adding contributors who are already demonstrating technical skill and leadership within the project. So I am pleased to announce that we are adding Tomasz (Tomek) Zawadzki to the core maintainer team!
Continue...SPDK v19.07 Release: NVMe-oF FC Transport, VMD, NVMe-oF Persistent reservations, Bdev I/O with separate metadata
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.07!
Continue...SPDK v19.04.1: Maintenance Release
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.04.1!
Continue...10.39M Storage I/O Per Second From One Thread
Yes, you’re reading that right. That’s 10.39 MILLION 4KiB random read I/O operations per second on a single thread. Mind blown? Don’t believe it? This blog post will explain exactly how we’ve done it.
Continue...SPDK v19.04: Compression bdev, Notification library, NVMe Opal support
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.04!
Continue...Presentations: SPDK, PMDK and Intel® VTune™ Amplifier Summit on April 16-17, 2019
Thank you all for attending the SPDK, PMDK and Intel® VTune™ Amplifier Summit. We had a very successful SPDK summit this year with awesome content and presenters. You can download the presentations using the links below. Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation.
Continue...SPDK and OpenStack
The official OpenStack Stein release has been announced and for the first time it includes new SPDK Cinder target and volume drivers. This adds support for SPDK NVMe-oF target in OpenStack. Details about the OpenStack Cinder Block Storage service release can be found in the release notes and detailed documentation on drivers can be found in the SPDK Cinder drivers documentation.
Continue...19.01.1 SPDK NVMe-oF Performance Report
Performance report for SPDK 19.01.1 NVMe-OF has been published in the Documentation section on www.spdk.io. SPDK 19.01.1 NVMe-oF Performance Report
Continue...SPDK v19.01.1: Maintenance Release
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.01.1!
Continue...SPDK Introduction on Oracle Linux
An introduction to the SPDK and its coming availability to Oracle Linux was published on Oracle’s Linux blog site. This will be the first Linux distribution that packages SPDK!
Continue...Announcing The US SPDK Summit!
Save The Date
2019 Storage Performance Development Kit (SPDK) Summit
April 16th-17th
Dolce Hayes Mansion, San Jose
200 Edenvale Ave, San Jose, CA 95136
http://www.hayesmansion.com
SPDK v19.01: NVMe-oF TCP/IP Transport, Open Channel SSD Flash Translation Layer, Caching bdev based on OCF, ISA-L Support, DIF/DIX library
On behalf of the SPDK community I’m pleased to announce the release of SPDK 19.01!
Continue...SPDK v18.10.1: Packaging release
On behalf of the SPDK community I’m pleased to announce the release of SPDK 18.10.1!
Continue...SPDK NVMe-oF TCP Transport
NVM Express has ratified TCP as a new transport for NVMe-oF! The announcement can be found here. Quoting from the NVM Express announcement:
Continue...Hitachi SPDK NVMe-oF Performance Report
We have been doing some work to evaluate the performance of SPDK and gain some hands-on experience with the SPDK NVMe-oF Target and Initiator. The Hitachi SPDK NVMe-oF Performance Report contains our test configuration and performance results. In summary, we observed up to 8x more IOPS/Core with SPDK NVMe-oF Target and Initiator, vs the Linux Kernel, and a 90% reduction in the software latency. Many thanks to John Kariuki and the SPDK team.
Continue...New Core Maintainer - Darek Stojaczyk
The SPDK project has a team of core maintainers who are responsible for providing technical oversight for the SPDK project, including final review and merging of patches into the SPDK code base. As the SPDK project continues to grow, the core maintainer team needs to grow as well. With that in mind, I am pleased to announce that we are adding Dariusz (Darek) Stojaczyk to the core maintainer team!
Continue...SPDK v18.10: Dynamic memory allocation, Crypto vbdev, jsonrpc-client, SPDKCLI iSCSI and NVMe-oF support
On behalf of the SPDK community I’m pleased to announce the release of SPDK 18.10!
Continue...The 2018 SPDK Developer Meetup Hosted by NetApp
This year NetApp hosted the SPDK Developer Meetup in beautiful Sunnyvale CA on 10/16 and 10/17. HUGE thanks to John Meneghini and the rest of the NetApp crew. We had community members from all over the world present with a record breaking attendance of over 30 developers!
Continue...SPDK 18.04 Performance Reports
The following SPDK 18.04 Performance Reports have been published in the Documentation tab on www.spdk.io.
Continue...Test your SPDK application with Intel® Optane™ SSDs
Intel and Packet are working together to bring free infrastructure for testing and benchmarking with Intel® Optane™ SSDs to the developer community. This community lab is a perfect fit for the SPDK community that cares about getting the most from their storage applications. Interested in testing your SPDK application on the world’s most responsive data center SSD? Head over to Accelerate with Optane for more information, and, once you’re ready, request access. The lab will provide you with a highly capable bare metal server powered by Intel Xeon® Scalable processors, with three 750GB Intel Optane™ SSD DC P4800X and one 4TB Intel SSD DC P4500 for comparison purposes.
Continue...Announcing the 2018 SPDK Developer Meetup hosted by NetApp
Come and join the 2nd annual SPDK Developer Meetup, this year hosted by NetApp in beautiful Sunnyvale CA! It’s an excellent opportunity for networking, learning and making forward progress on the code and generally making the community more productive. We’ll be covering all sorts of topics but a major theme this year will be NVMeOF (including FC support) so if you’re interested in these topics you won’t want to miss this meet-up.
Continue...2018 SPDK US Summit Recap
Here is a recap of 2018 SPDK Summit at the beautiful Dolce Hayes Mansion, San Jose on May 15th and 16th. We had a successful event and achieved all of our goals. Thanks to the dedication and support of many contributors and great participation from SPDK community members.
Continue...Videos: SPDK PRC Summit on March 23, 2018 at Beijing
All the videos from the 2018 SPDK PRC Summit are located here. Brief introduction about these videos are also included in the same folder.
Continue...2018 SPDK PRC Summit presentations now available
Thank you all for attending the SPDK PRC Summit held at March, Beijing, China. We had a very successful SPDK summit this year with awesome content and presenters.
Continue...2018 SPDK US Summit presentations now available
Thank you all for attending the SPDK Summit. We had a very successful SPDK summit this year with awesome content and presenters.
Continue...SPDK v18.04: Logical Volume Snapshot/Clone, iSCSI Initiator, Bdev QoS, VPP Userspace TCP/IP
Today, the SPDK team is proud to announce the v18.04 release.
Continue...Register Now for the 2018 US SPDK Summit
Register Now
2018 Storage Performance Development Kit (SPDK) Summit
May 15th -16th
Dolce Hayes Mansion, San Jose
200 Edenvale Ave, San Jose, CA 95136
http://www.hayesmansion.com
Announcing The US SPDK Summit!
Save The Date
2018 Storage Performance Development Kit (SPDK) Summit
May 15th -16th
Dolce Hayes Mansion, San Jose
200 Edenvale Ave, San Jose, CA 95136
http://www.hayesmansion.com
SPDK Test Script Hierarchy
As the SPDK code base has been growing, so has the collection of test scripts used by the automated build pool to perform continuous integration testing. The SPDK test bed is comprised of a hierarchy of bash scripts which make calls to example applications (located under spdk/examples) and tools written for testing (located under spdk/test). By running these test scripts and aggregating the results, the SPDK automated test pool helps contributors identify code errors or continuous integration issues introduced by their patches.
Continue...New SPDK Community Meetings!
SPDK Community meetings are open to everyone and all are encouraged to participate. Here are the details:
Continue...How Long Did My Test Take?
When submitting a new unit test, it’s not necessary to worry too much about how long the test takes because there’s no real hardware involved so the unit tests execute super-fast.
Continue...SPDK v18.01: Blobstore Thin Provisioning
The SPDK team is proud to announce the v18.01 release.
Continue...Core Maintainers - New Additions
The SPDK project has a team of core maintainers who are responsible for providing technical oversight for the SPDK project. I am pleased to announce that we are adding Shuhei Matsumoto and Changpeng Liu to the core maintainer team!
Continue...SPDK v17.10 and v17.10.1: Logical Volumes
The SPDK team is proud to announce the v17.10 release, as well as the v17.10.1 release (see below for details on the changes between v17.10 and v17.10.1). This release adds a major new feature, Logical Volumes.
Continue...Success! SPDK's First Developer Meetup...
This week members of the growing SPDK Community met for the first ever SPDK Developer Meetup. Engineers from Massachusetts, Arizona, California, Washington, China, Japan and the United Kingdom all came together in Chandler, AZ, to meet for 2 days of discussions on everything from NVMe to vhost to the community test strategy, roadmap and upcoming improvements.
Continue...Performance Report Section
Performance Report section has been added under Documentation tab on www.spdk.io.
Continue...SPDK Developer Meetup is Now Full!
It’s going to be awesome! Although we’re now at capacity, please feel free to email Paul and we’ll make sure we do everything we can to accommodate you.
Continue...Announcing the first SPDK Developer Meetup
Come and join the very first SPDK Developer Meetup! It’s an excellent opportunity for networking, learning and making forward progress on the code and generally making the community more productive. There won’t be any presentations at this meeting, instead be prepared for the following types of activities:
Continue...SPDK 17.07 Release: Build system improvements, userspace vhost-blk target, and GPT bdev
The SPDK team is proud to announce the v17.07 release. This release incorporates a number of ease-of-use improvements and API cleanups.
Continue...Videos: Intel® Builders Developer Summit on April 19-20, 2017
Videos from the Intel Builders Developers Summit featuring SPDK and ISA-L held in Santa Clara on April 19th and 20th are posted here.
Continue...Presentations: Intel® Builders Developer Summit on April 19-20, 2017
Please note these are static PDFs, but many of the presentations made extensive use of animations, so something may be lost in translation. There will be video available soon; links will be added in a separate post.
Continue...SPDK 17.03 Release: VM Optimization & Blobstore
Today, the SPDK team is proud to announce the v17.03 release. This release features two significant new sets of components which will unlock a broader set of use cases for SPDK.
Continue...Intel Builders Developer Summit Featuring SPDK & ISA-L
Meet with key contributors to SPDK, learn details about the latest and upcoming SPDK ingredients, and participate in roundtable discussions that will shape the SPDK community. The two day event also includes introductions to adjacent software libraries and opportunities for informal networking and private discussions.
Continue...SPDK 16.12 Release
Today we have released SPDK 16.12. This release contains the following major additions since our last release:
Continue...Announcing the SPDK NVMf Target
Much has already been said about NVMe over Fabrics. It was first publicly demonstrated in 2014 and the 1.0 specification is finally complete. In essence, NVMe over Fabrics (NVMf) is the NVM Express* (NVMe) block protocol tunneled through an RDMA fabric, and it has enormous potential to enable the next generation of datacenter storage development. To support broad adoption of NVMf, the Storage Performance Development Kit (SPDK) has created a reference user-space NVMf target implementation for Linux, released for community involvement via GitHub under BSD license. In parallel, community-based Linux* kernel efforts have created both a host and a target under GPL license. All three of these implementations are now released with the final 1.0 specification as of June 8, 2016.
Continue...Why SPDK?
Solid-state storage media is in the process of taking over the data center. Current-generation flash storage enjoys significant advantages in performance, power consumption, and rack density over rotational media. These advantages will continue to grow as next-generation media enter the marketplace.
Continue...NVMe API Changes
Over the last month, the API of the NVMe driver in SPDK has changed significantly. First, on behalf of the SPDK team, I’m sorry for breaking any existing code! SPDK is still in its infancy, so dramatic API changes will be a fact of life for the next few months. By the end of the year, we’d like to have a plan in place to manage future API changes in a more formal way. Second, I’d like to take a few moments to explain what changes were made and why we made them. I’ll stick to a mostly high level overview of the API changes for now, but we hope to produce some additional blog posts that detail each one in the future.
Continue...Introduction to the Storage Performance Development Kit
The Storage Performance Development Kit (SPDK) provides a set of tools and libraries for writing high performance, scalable storage applications. It achieves high performance by moving all of the necessary drivers into userspace and operating in a polled mode instead of relying on interrupts. It is primarily designed to be leveraged by OEMs and cloud service providers to optimize their storage solutions. Generally, guidelines from the related networking project DPDK should be followed. Specifically, their guide for writing efficient code almost all applies to SPDK.
Continue...