During his first year as a professor of computer science at the University of California, Berkeley, Ren Ng was hurriedly putting together a survey course on computer graphics. In the syllabus he had inherited, a full week had been devoted to the subject of color. Ng thought that was a bit much. “I’m, like, Come on. It’s R.G.B.,” he said, referring to the red, green, and blue subpixels that constitute anything you see on a screen—your cluttered desktop, a Sahara-desert screen saver, the stream of the Netherlands-Japan World Cup game. Ng started gathering slides that would cover the wavelengths of light, the biology of the human eye—the basics—“Blah, blah, blah,” he said. A colleague shared a slide that he thought might be useful. It included a minutely detailed photograph of a patch of retina, seen through a microscope, which was attributed to Austin Roorda, a professor of vision science and optometry just across campus. Roorda’s lab had helped develop technology that could map the layout of individual cone cells—those primarily responsible for perceiving color—and that, furthermore, could target a single cone cell with light. Eyes are constantly moving; cone cells are extremely small; how color is translated from the millions of cone cells to the mind remains pretty mysterious; this was awesome work. Roorda’s lab was using the new technology to explore eye disease and the mechanics of how we see. Ng had his own notion, though: he wondered if it could be used to see a color that had never been seen before.
To understand what Ng had in mind requires knowing a bit of the blah, blah, blah of color vision. We humans experience three primary colors not because the world is fundamentally composed of three colors but because our retinas typically have three kinds of color-perceiving cone cells. L cone cells respond to the relatively longer wavelengths of visible light, M cone cells to the medium wavelengths, and S cone cells to the shorter ones. In effect, this means that L cells respond most strongly to red light, M to green, and S to blue. But when you look at your hand—or a blade of grass, or a clear blue sky, or a fire truck—it is always some mixture of L, M, and S cone cells that are being stimulated.
Ng’s idea was to use the Roorda lab’s technology to stimulate an array of cone cells in a manner that would never occur naturally. Ng said, “I e-mailed him, basically, What would happen if you stimulated only the M cells? Would that be like the greenest green, or what?” Roorda did not reply. This was 2016. Ng taught his computer-graphics course, pursued other research, and mostly forgot about his query. A year later, when he taught the course a second time, his curiosity returned, so he reached out to Roorda again. No response. When Ng was teaching the course for a third time, in 2018, he realized that he really was very curious about this question. He composed a lengthy note to Roorda, organized like a research proposal, titled “The Grass Is Greenest in Oz Vision.” In it, Ng imagined a future where people wore “Oz Vision eyeglass displays,” which would be based on the retinal cone-cell mapping and laser stimulation that Roorda’s lab was already doing. The Oz glasses would activate any pattern of retinal cone cells one chose. Ng’s hypothesis was that, if retinal cells were stimulated in ways that don’t occur naturally, “the set of perceivable colors” would be “significantly larger than the natural gamut of the human eye.” He imagined people discussing “the indescribable green of the grass in Oz,” then concluded that, although the Oz display “is science fiction,” his note was “a real proposal for joint research.” Roorda finally replied, proposing coffee. “I get a lot of e-mails suggesting what I should research,” Roorda told me, of the time it took him to respond.
In the children’s novel “The Midnight Fox,” by Betsy Byars, the main character daydreams about digging in his back yard and coming across a “brand-new color.” A friend of mine remembers being captivated by this scene, and trying to picture the color. “I felt like I could conceive of it, but I couldn’t see it,” she said. The eighteenth-century Scottish philosopher David Hume considered at length whether a person who had seen every shade of blue except for one would be able to picture that one un-experienced shade; he concluded that the answer was yes. In my youth, I spent an afternoon wondering if I would have been able to imagine the fluorescent yellow of highlighter markers if I’d never seen it.
When I first read about Ng and Roorda’s work, I tried to visualize what it would mean for there to be a new color. Where would it go in a color wheel? If you think of color as a property of a specific wavelength of light—which is how I thought of it—then you run into the impossibility of there being a “new” visible wavelength. As humans, we can see wavelengths from roughly 380 nanometres (which looks violet to us) to about 750 nm. (which looks red). Wavelengths shorter than 380 nm., which we’d call ultraviolet, are invisible to us (but not to bees or hummingbirds), as are wavelengths longer than 750 nm., which we refer to as infrared (and which snakes and salmon can perceive). The “greenest green” that Ng had in mind was neither ultraviolet nor infrared. It was not a new wavelength at all. If I wanted to picture this green, or at least try to, I would first have to understand that even the old familiar colors are much more complex than a particular wavelength of light.
I’m having a fun time reading about color science and then a murder suicide out of freaking nowhere and then it’s right back to fun color talk two sentences later as if nothing happened.
I saw a guy around reddit for a while who was convinced he could functionally cure colorblindness via stereoscopic vision (for people playing video games with VR). He reasoned that if each eye is seeing a different color in the same place then observers can train themselves to see that hybrid as a new color instead of an unstable blob of both. As time went on, though, he seemed to grow more and more obsessed with the idea of himself as a functional tetrachromat, and the accessibility feature of it all took on the character of a happy side benefit to his pursuit of personal chromatic dominance.
I kind of hoped I would see him pop up in the article, as silly as his version of “new color” was. With no information of what ultimately became of his project, I’m forced to assume he crossed paths with a natural tetrachromat and destroyed his research so that she could never use it to surpass his ultimate color vision.
Back to the article, though, I myself am an anomalous trichromat which means I have some potentially exciting news for my mother about her own eyes.
I’m forced to assume he crossed paths with a natural tetrachromat and destroyed his research so that she could never use it to surpass his ultimate color vision.
Maybe we should investigate all the recent murder suicides to see if we can find him?
Impossible colors are so cool.
‘“I would say you might get olo by staring at a saturated red spot and then looking at a green screen of a very saturated bluish-green,” he told me’
This is well established and easy to do, eg https://www.skytopia.com/project/illusion/ipage-et.html or https://en.wikipedia.org/wiki/Impossible_color#Chimerical_colors. I wish they had interviewed someone who had tried both.“Ho, hum.” -Mary


