知Yizhi Daily
← Back to this edition

Conversations

Former systems engineer recalls false smoke alarm that nearly affected Jane Street's New York server room

Edition 2026-11-12 · 08:00 Beijing time

A personal recollection article on Hacker News describes how Jane Street early on housed its server room inside the 1 New York Plaza office building in New York, close to the trading floor. A former systems team member said dust from construction in an adjacent prep room once triggered a smoke alarm. At the point where the material cuts off, the article introduces the alarm background and the company's risk culture emphasizing physical power disconnection; the later flooding sequence is not provided in full.

Writing as a former member of Jane Street's systems team, the author recalls that the company long insisted early on on placing the server room near the trading floor. That was acceptable when the company numbered only about 10 people, but by the time it reached about 150 people it had come to seem strange. One reason was concern over intellectual property: the company did not want servers to be taken away and trading strategies leaked. Another was technical risk control: it wanted an out-of-control automated trading system to always be something a person could run down the hallway and unplug.

The author said the company was not without tools to mitigate these risks, but it moved slowly on relevant changes and still wanted to retain pulling the power cord as a last resort. This risk culture was influenced by a partner who had served on a nuclear submarine: in a submarine environment, automation should not be fully trusted unless there was a large, red, mechanically linked control lever.

As the company expanded, the simple server room grew into a sizable data center equipped with online UPS units, precision air conditioning, refrigerator-sized network switches, an underground diesel backup generator, and about 10 rows of server racks with 10 rack depths per row. They were housed in 1 New York Plaza, an ordinary New York skyscraper office building.

The author recalls that he was living in a small apartment about a nine-minute walk from the office, making him an easy person to contact in emergencies. One evening after work, just as he was about to enter his apartment elevator, the Hong Kong office called to say that the New York data center's smoke alarm had gone off. The material shows that contractors were then doing construction work in a prep room next to the data center, and cutting work raised dust and triggered the alarm. But the provided main text cuts off there and does not provide the later details behind the title's claim that the server room was “almost flooded.”

Original sources

Hacker News ↗
Back to this editionOpen interactive reader