Clik here to view.
VAST Data's storage system architecture
VAST Data, Inc, an interesting new storage company, unveiled their new all-flash storage system today amidst a good amount of hype and fanfare. Â There's no shortage of marketing material and trade...
View ArticleClik here to view.
ISC'19 Recap
I was fortunate enough to attend the ISC HPC conference this year, and it was a delightful experience from which I learned quite a lot. Â For the benefit of anyone interested in what they have missed, I...
View ArticleClik here to view.
SC'19 Recap
Last week was the annual Supercomputing conference, held this year in Denver, and it was its usual whirlwind of big product announcements, research presentations, vendor meetings, and catching up with...
View ArticleClik here to view.
Understanding random read performance along the RAIDZ data path
Although I've known a lot of the parameters and features surrounding ZFS since its relative early days, I never really understood why ZFS had the quirks that it had. Â ZFS is coming to the forefront of...
View ArticleExascale's long shadow and the HPC being left behind
The delivery of Japan's all-CPU Fugaku machine and the disclosure of the UK's all-CPU ARCHER 2 system amidst the news, solidly "pre-Exascale" machines with pre-exascale budgets, is opening old wounds...
View ArticleClik here to view.
The joy of buying a standing desk during the pandemic
When my employer announced that we were all going to work remotely back in March, I had no semblance of a home office and had to scramble to figure out how to set up a space in my small urban apartment...
View ArticleClik here to view.
PDSW'20 Recap
This year was the first all-virtual Parallel Data Systems Workshop, and despite the challenging constraints imposed by the pandemic, it was remarkably engaging. Â The program itself was contracted...
View ArticleClik here to view.
SC'20 Recap
The HPC industry's biggest conference, SC, was held virtually over the last two weeks. Although the original plan to hold it in Atlanta was supplanted by all-virtual format, it still managed to be a...
View ArticleClik here to view.
IOPS are dumb
This post is a long-form dump of some thoughts I've had while testing all-flash file systems this past year, and I'll be harping on many of these themes at SC'21 this year. Â Bits of this appear in a...
View ArticleClik here to view.
Life and leaving NERSC
When word started to spread that I was leaving my job at NERSC for Microsoft, a lot of people either directly or indirectly attributed my decision to being one motivated by money. Rationalizing my...
View ArticleClik here to view.
SC'22 Recap
The biggest annual conference in HPC, the SC conference, was recently held in Dallas, Texas in its second hybrid incarnation since being all-remote for the pandemic. This year attracted over 11,000...
View ArticleClik here to view.
SC'23 Recap
The largest high-performance computing industry conference of the year, SC23, was held in Denver last week. This year's conference attracted over 14,000 attendees and 438 exhibitors, finally breaking...
View ArticleClik here to view.
A closer look at "training" a trillion-parameter model on Frontier
A paper titled "Optimizing Distributed Training on Frontier for Large Language Models" has been making its rounds over the last few weeks with sensational taglines saying the authors trained a...
View ArticleOn the road to Hamburg for ISC'24
I have the great fortune of being able to attend to the 2024 ISC High Performance conference in Hamburg next week where I will be both speaking and listening throughout the contributed program and the...
View ArticleClik here to view.
ISC’24 recap
I had the great pleasure of attending the ISC High Performance conference this month, marking the fifth time I've attended what has become one of my top must-attend industry conferences of the year....
View ArticleClik here to view.
How has life after leaving the Labs been going?
June 2024 marked two years since I left my job at one of the world's most prestigious government HPC centers for a job in one of the world's largest technology corporations. In that time, the world of...
View ArticleClik here to view.
A critique of the call for public AI
As I spend more time in the AI infrastructure business, I've been thinking more and more about the government's role in AI. There's no shortage of opinions and position papers on the topic, and sadly,...
View ArticleClik here to view.
FASST will be DOE's opportunity to adapt, align, or...
These are some personal thoughts I’ve had in response to Notice of Request for Information (RFI) on Frontiers in AI for Science, Security, and Technology (FASST) Initiative.The premise of the RFI...
View ArticleClik here to view.
SC'24 recap
The premiere annual conference of the high-performance computing community, SC24, was held in Atlanta last week, and it attracted a record-shattering number of attendees--nearly 18,000 registrants, up...
View ArticleClik here to view.
LLM training without a parallel file system
The illustrious Jeff Denworth recently posted a hot take across social media, claiming that training large language models (LLMs) doesn't require massive, expensive parallel file systems:As someone...
View Article