Difference between revisions of "Main Page"

From OpenZFS
Jump to navigation Jump to search
 
(178 intermediate revisions by 5 users not shown)
Line 1: Line 1:
<div id="mf-home">
= Welcome to OpenZFS =
= Welcome to OpenZFS =
__NOTOC__
__NOTOC__




== Summary ==
== [[OpenZFS Developer Summit 2023]] ==


OpenZFS was [[announcement | announced in September 2013]] as the truly '''open source''' successor to the [[History | ZFS project]]. Our community '''brings together developers''' from the illumos, FreeBSD, Linux, and OS X [[distributions | platforms]], and a wide range of [[companies]] that build products on top of OpenZFS.  
The eleventh annual OpenZFS Developer Summit was held in San Francisco '''Oct 16-17 (Mon-Tue), 2023'''.


OpenZFS is an '''outstanding storage platform''' that encompasses the functionality of traditional filesystems, volume managers, and more, with consistent reliability, functionality and performance across all [[distributions]]:
===Presentations===


{| class="wikitable"
{| class="wikitable"
| '''illumos'''
|[http://wiki.illumos.org/display/illumos/ZFS Webpage]
|[https://github.com/illumos/illumos-gate/ GitHub]
|-
|-
| '''FreeBSD'''
!Title!!Speaker!!Company!!Slides!!Video
|[https://wiki.freebsd.org/ZFS Webpage]
|[https://github.com/freebsd/freebsd/ GitHub]
|-
|-
| '''ZFS on Linux'''
| [[OpenZFS_Developer_Summit_2023_Talks#Introducing_Fast_Dedup_(Allan_Jude) | Introducing Fast Dedup]] ||Allan Jude || Klara Inc.||[https://openzfs.org/w/images/3/3b/Klara_-_Introducing_Fast_Dedup_-_OpenZFS2023.pdf slides] || [https://www.youtube.com/watch?v=_T2lkb49gc8&list=PLaUVvul17xSegbzdTT2Mo-QCDzEn5Z3XC&index=1&pp=iAQB video]
|[http://zfsonlinux.org/ Webpage]
|[https://github.com/zfsonlinux/zfs/ GitHub]
|-
|-
| '''OpenZFS on OS X'''
| [[OpenZFS_Developer_Summit_2023_Talks#Z.I.A._Accelerates_ZFS_Compression,_Checksumming,_and_RAIDZ_(Jason_Lee) | Z.I.A. Accelerates ZFS Compression, Checksumming, and RAIDZ]] || Jason Lee || Los Alamos National Labs || [https://openzfs.org/w/images/a/a2/Z.I.A..pdf slides] || [https://www.youtube.com/watch?v=mKDDKG0yVRg&list=PLaUVvul17xSegbzdTT2Mo-QCDzEn5Z3XC&index=3 video]
|[https://openzfsonosx.org/ Webpage]
|[https://github.com/openzfsonosx/ GitHub]
|}
 
== ZFS User Conference ==
The first ZFS User Conference was held March 16-17, 2017, in Norwalk CT. Videos and slides from the conference are available here: [http://zfs.datto.com/ zfs.datto.com]
 
== [[OpenZFS Developer Summit 2016]] <= click for details ==
 
The fourth annual OpenZFS Developer Summit was held in San Francisco, '''September 26-27th, 2016'''.
Check out the following blog posts about the event:
<ul>
<li>[https://www.delphix.com/blog/delphix-engineering/thank-you-openzfs-2016-developers-summit-sponsors Delphix Blog: Thank you OpenZFS 2016 Developers Summit Sponsors!]</li>
<li>[https://www.ixsystems.com/blog/openzfs-devsummit-2016/ iXsystems Blog: OpenZFS: Stronger Than Ever]</li>
</ul>
 
Click on the title of the presentation for more details.
 
{| class="wikitable"
|-
!Title!!Speaker!!Company!!Video!!Slides
|-
|State of the Union||Matt Ahrens||[http://www.delphix.com/ Delphix]||[https://youtu.be/CIJGUNDZ9yE Video]|| [https://drive.google.com/file/d/0B5hUzsxe4cdmcVpoR0N6cEJLeFU/view?usp=sharing Slides]
|-
|Keynote||Dustin Kirkland||[http://canonical.com/ Canonical]||[https://youtu.be/nDmvwevnJNc Video]||N/A
|-
|-
|Lustre, Supercomputers, and ZFS||Brian Behlendorf||[http://llnl.gov LLNL]||[https://youtu.be/RoyrIocAByU Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmLVRwZy1WY19LYkE/view?usp=sharing Slides]
| [[OpenZFS_Developer_Summit_2023_Talks#Idmapped_Mount_Support_in_ZFS_and_its_Application_(Youzhong_Yang) | Idmapped Mount Support in ZFS and its Application]] ||Youzhong Yang || MathWorks || [https://openzfs.org/w/images/5/56/Idmapped-mount-support-and-its-application-2.pptx slides] || [https://www.youtube.com/watch?v=tTHUtegxfro&list=PLaUVvul17xSegbzdTT2Mo-QCDzEn5Z3XC&index=3&pp=iAQB video]
|-
|-
|[[ZFS and Containers]]||Michael Crogan|| ||[https://youtu.be/HOCihVmsbwQ Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmbTRBXzZPN3BrbDQ/view?usp=sharing Slides]
| [[OpenZFS_Developer_Summit_2023_Talks#RAIDZ_Expansion_(Matt_Ahrens_&_Don_Brady) | RAIDZ Expansion]] || Matt Ahrens; Don Brady || Delphix, FreeBSD Foundation; Klara Inc, iXsystems || [https://openzfs.org/w/images/5/5e/RAIDZ_Expansion_2023.pdf slides] || [https://www.youtube.com/watch?v=tqyNHyq0LYM&list=PLaUVvul17xSegbzdTT2Mo-QCDzEn5Z3XC&index=3&pp=iAQB video]
|-
|-
|Channel Programs||Sara Hartse & Chris Williamson||[http://delphix.com Delphix]||[https://youtu.be/ogOwo4mZxMA Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmTVFUb2ItekRaU2s/view?usp=sharing Slides]
| [[OpenZFS_Developer_Summit_2023_Talks#OpenZFS_at_scale:_learning,_challenges,_and_awesome_customers_(Sam_Atkinson) | OpenZFS at scale: learning, challenges, and awesome customers]] ||Sam Atkinson || AWS || [https://openzfs.org/w/images/a/a0/OpenZFS_At_Scale_-_AWS.pptx slides] || [https://www.youtube.com/watch?v=6Jt9LQcobXM&list=PLaUVvul17xSegbzdTT2Mo-QCDzEn5Z3XC&index=4&pp=iAQB video]
|-
|-
|ZFS First Mount||Mark Shellenbaum||[http://www.oracle.com Oracle]||[https://youtu.be/xMH5rCL8S2k Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmT1lDS3JaUlhwc1E/view?usp=sharing Slides]
| [[OpenZFS_Developer_Summit_2023_Talks#Shared_Log_Pool_(Paul_Dagnelie) | Shared Log Pool]] || Paul Dagnelie ||Delphix || [https://openzfs.org/w/images/0/03/Shared_Log_Pool.pdf slides] || [https://www.youtube.com/watch?v=Z5L44a2gJdg&list=PLaUVvul17xSegbzdTT2Mo-QCDzEn5Z3XC&index=6&pp=iAQB video]
|-
|-
|[[Scrub/Resilver Performance]]||Saso Kiselkov||[http://www.nexenta.com/ Nexenta]||[https://youtu.be/SZFwv8BdBj4 Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmVU91cml1N0pKYTQ/view?usp=sharing Slides]
|-
|[[ZFS-Native Encryption]]||Tom Caputi||[http://www.datto.com Datto]||[https://youtu.be/frnLiXclAMo Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmU3ZTRXNxa2JIaDQ/view?usp=sharing Slides]
|-
|[[Fault Management]]||Don Brady & Justin Gibbs||[http://www.intel.com/ Intel] & [https://www.freebsdfoundation.org/ FreeBSD Foundation]||[https://youtu.be/zJbQiqdcpDg Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmeGFNRzZKV2J0blE/view?usp=sharing Slides]
|-
|[[ZFS Validation & QA]]||Sydney Vanda & John Salinas||[http://www.intel.com/ Intel]||[https://youtu.be/N0OZN8Z2IX0 Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmalBiay1EdHdMbWs/view?usp=sharing Slides]
|-
|Closing||Matt Ahrens||[http://www.delphix.com/ Delphix]||[https://youtu.be/kn5xnqKehfY Video]||N/A
|}
|}


Thanks to the 2016 Platinum sponsors for their support!
See [[OpenZFS Developer Summit 2022]] for presentations and information about last year's conference.


<div><ul>
== Introduction to OpenZFS ==
<li style="display: inline-block; padding-bottom: 70px;"> [[File: Delphix logo.png|170x150px|link=http://delphix.com | right | Delphix]] </li>
<li style="display: inline-block; padding: 20px;"> [[File: Intel.png|120x120px|link=http://www.high-availability.com/ | right | Intel ]]</li>
<li style="display: inline-block; padding: 20px; padding-bottom: 60px;"> [[File: OsNexus.png|150x150px|link=http://www.osnexus.com/ | right | OSNexus ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 60px;"> [[File: Nexenta.png|150x150px|link=http://www.nexenta.com/ | right | Nexenta ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 70px;"> [[File: Datto_logo_2015.jpg|80x80px|link=http://www.datto.com/ | right | datto ]] </li>
</ul></div>


== Goals ==
'''OpenZFS''' is an open-source storage platform. It includes the functionality of both traditional file systems and volume manager. It has many advanced [[Features | features]] including:
* Protection against data corruption. Integrity checking for both data and metadata.
* Continuous integrity verification and automatic “self-healing” repair
** Data redundancy with mirroring, RAID-Z1/2/3 [and DRAID]
* Support for high storage capacities — up to 256 trillion yobibytes (2^128 bytes)
* Space-saving with transparent compression using LZ4, GZIP or ZSTD
* Hardware-accelerated native encryption
* Efficient storage with snapshots and copy-on-write clones
* Efficient local or remote replication — send only changed blocks with ZFS send and receive


The high-level goals of OpenZFS are:
== Contributing to OpenZFS ==
* to '''raise awareness''' of the quality, utility, and availability of open source implementations of ZFS
The OpenZFS project brings together developers from the Linux, FreeBSD, illumos, MacOS, and Windows platforms.  OpenZFS is supported by a wide range of companies.  
* to encourage '''open communication''' about ongoing efforts to improve open source ZFS
* to ensure '''consistent reliability''', functionality, and performance of all distributions of ZFS.


The main technical goal of OpenZFS is '''easier sharing of code''' between platforms. Strategies include:
There are many ways to contribute to OpenZFS including:
* creating a platform-independent [[mailing list]] for developers to review ZFS code and architecture changes from all platforms
* OpenZFS uses [https://github.com/openzfs/zfs GitHub] to track [https://github.com/openzfs/zfs/issues bug reports] and [https://github.com/openzfs/zfs/pulls feature development]
* smoothing the [[illumos integration process]]
* A monthly [[OpenZFS_Leadership_Meeting | OpenZFS Leadership Meeting]] Zoom call to discussion active development
* making it easy to run both ztest and the ZFS test suite (TestRunner or STF based) on each platform
* The annual [[OpenZFS_Developer_Summit | OpenZFS Developer Summit]]
* [[Reduce code differences | reducing code differences]] between the platforms.


== What's new? ==
== Get Started with OpenZFS ==
September 2016: [[OpenZFS Developer Summit 2016]] will be held September 26-27th in San Francisco.
[https://openzfs.github.io/openzfs-docs/Project%20and%20Community/FAQ.html Frequently Asked Questions]


October 2015: Slides and video from the [[OpenZFS Developer Summit 2015]] are posted.
[[Newcomers | OpenZFS concepts]]


June 2015: Videos from the [http://www.open-zfs.org/wiki/Publications#2015_OpenZFS_European_Conference OpenZFS European Conference] are posted.
A non-exhaustive list of [[Features | OpenZFS features]]


== Site orientation ==
== OpenZFS Technical Resources ==
* [[FAQ]]
[https://openzfs.github.io/openzfs-docs/Getting%20Started/index.html How to install OpenZFS]
* How to [[participate]]
* [[Companies]] with products that are based on OpenZFS
* Download [[distributions]] that include OpenZFS
* [[Events]] – the forthcoming [[OpenZFS Developer Summit]] and more
* [[Developer resources]]
** [[mailing list]]
** [[illumos integration process]]
** [[contributors]]
** [[platform code differences]]
** [[OpenZFS Office Hours]]
** implementation
*** [[Documentation/ZfsSend | ZFS send]]
*** [[Documentation/Administrative Commands | administrative commands]]
* [[System Administration|Documentation]] for users/sysadmins
** [[features]]
** [[Feature Flags| feature flags]]
** [[Publications| publications and conference talks]]
** [[history]] – from ZFS to OpenZFS
*** OpenZFS launch [[announcement]] – September 2013
** [[performance tuning]]
* [[Projects]]
** [[reduce code differences]]
** the [[Projects/ZFS Channel Programs | ZFS Channel Programs]] (ZCP) proposal
* [[About OpenZFS]]


[http://open-zfs.org/w/index.php?title=Special%3AAllPages&from=&to=&namespace=0&hideredirects=1 All main pages] (alphabetical order) …
[https://openzfs.github.io/openzfs-docs/man/index.html OpenZFS manual pages]


== Twitter ==
Feature Details.  Detailed subsystem/feature blogs, on-disk format specifications: [[Developer_resources | Developer Resources]]
 
== Donate ==
 
We accept donations to cover our ongoing costs.
 
OpenZFS is an associated project of SPI ([https://www.spi-inc.org/projects/openzfs/ Software in the Public Interest]).  SPI is a 501(c)(3) nonprofit organization which handles our donations, finances, and legal holdings.  You can donate through paypal using the link below:


<html>
<html>
<a class="twitter-timeline" width="720" height="437" href="https://twitter.com/OpenZFS" data-widget-id="378639669799288832">Tweets by @OpenZFS</a>
<script>!function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)?'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+"://platform.twitter.com/widgets.js";fjs.parentNode.insertBefore(js,fjs);}}(document,"script","twitter-wjs");</script>
<span>
<br>
<br>
<a href="https://twitter.com/openzfs" class="twitter-follow-button" data-show-count="true">Follow @openzfs</a>
<form action="https://www.paypal.com/cgi-bin/webscr" method="post">
<input type="hidden" name="cmd" value="_s-xclick" />
<input type="hidden" name="hosted_button_id" value="X6KB4BFPRFAG6" />
<input type="image" src="https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif" name="submit" alt="Donate to OpenZFS via PayPal" />
<img alt="" src="https://www.paypalobjects.com/en_US/i/scr/pixel.gif" width="1" height="1" />
</form>
<br>
<br>
<a href="https://twitter.com/share" class="twitter-share-button" data-via="OpenZFS">Tweet</a>
</span>
<script>!function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)?'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+'://platform.twitter.com/widgets.js';fjs.parentNode.insertBefore(js,fjs);}}(document, 'script', 'twitter-wjs');</script>
</html>
</html>

Latest revision as of 05:20, 7 November 2023

Welcome to OpenZFS

OpenZFS Developer Summit 2023

The eleventh annual OpenZFS Developer Summit was held in San Francisco Oct 16-17 (Mon-Tue), 2023.

Presentations

Title Speaker Company Slides Video
Introducing Fast Dedup Allan Jude Klara Inc. slides video
Z.I.A. Accelerates ZFS Compression, Checksumming, and RAIDZ Jason Lee Los Alamos National Labs slides video
Idmapped Mount Support in ZFS and its Application Youzhong Yang MathWorks slides video
RAIDZ Expansion Matt Ahrens; Don Brady Delphix, FreeBSD Foundation; Klara Inc, iXsystems slides video
OpenZFS at scale: learning, challenges, and awesome customers Sam Atkinson AWS slides video
Shared Log Pool Paul Dagnelie Delphix slides video

See OpenZFS Developer Summit 2022 for presentations and information about last year's conference.

Introduction to OpenZFS

OpenZFS is an open-source storage platform. It includes the functionality of both traditional file systems and volume manager. It has many advanced features including:

  • Protection against data corruption. Integrity checking for both data and metadata.
  • Continuous integrity verification and automatic “self-healing” repair
    • Data redundancy with mirroring, RAID-Z1/2/3 [and DRAID]
  • Support for high storage capacities — up to 256 trillion yobibytes (2^128 bytes)
  • Space-saving with transparent compression using LZ4, GZIP or ZSTD
  • Hardware-accelerated native encryption
  • Efficient storage with snapshots and copy-on-write clones
  • Efficient local or remote replication — send only changed blocks with ZFS send and receive

Contributing to OpenZFS

The OpenZFS project brings together developers from the Linux, FreeBSD, illumos, MacOS, and Windows platforms. OpenZFS is supported by a wide range of companies.

There are many ways to contribute to OpenZFS including:

Get Started with OpenZFS

Frequently Asked Questions

OpenZFS concepts

A non-exhaustive list of OpenZFS features

OpenZFS Technical Resources

How to install OpenZFS

OpenZFS manual pages

Feature Details. Detailed subsystem/feature blogs, on-disk format specifications: Developer Resources

We accept donations to cover our ongoing costs.

OpenZFS is an associated project of SPI (Software in the Public Interest). SPI is a 501(c)(3) nonprofit organization which handles our donations, finances, and legal holdings. You can donate through paypal using the link below:



Retrieved from "https://openzfs.org/w/index.php?title=Main_Page&oldid=3242"