- Published on
Story of Nvidia
- Authors
- Name
- Garfield Zhu
- @_AlohaYo_
As the most import infrastructure of modern technology topics (AI, Machine Learning, Blockchain, etc.), let's witness how Nvidia reaches the pinnacle of the semi-silicon industry, and the unique role of computer hardwares.
@Author: Garfield Zhu
Story about NVIDIA
The new star in "Trillion Club". (2023)
And... The Man
History
Nasdaq: NVDA
0. Stock -See the history of the stock Nvidia first.
🌊 The tide of cutting-edge technologies bring NVIDIA where it is today.
1. Begining
- 1993: Founded in Santa Clara, California, USA.
- Founders: Jensen Huang, Chris Malachowsky, Curtis Priem.
- Produce Graphic Cards for bussiness customers.
- 3D Graphics for gaming and multimedia markets.
2. Developing
- 1999: GeForce 256, the first GPU.
- 1999: Nasdaq IPO.
- 2000: 3DFX (Voodoo, first customer-facing graphic card), the competitor, went bankrupt.
Nvidia acquired 3DFX. - As OEM, Nvidia produced GPUs for PC manufacturers.
3. New Vision
- Facing to gaming market. (GeForce)
- Decoupling the GPU from the PC. Face to customers directly.
- 2008: CUDA, the first GPU computing platform.
- Iterate GPU every 2-year. Keeping optimize the performance.
- 2010: General Purpose GPU (GPGPU) concept for scientific computing supported by CUDA API.
4. AI, AR, VR, Auto-pilot, Blockchain, Cloud
- 2015: CUDA enforced the Deep Learning neural network.
- 2016: Nvidia Drive PX, the first AI Auto-pilot platform.
- 2018: Nvidia announced Nvidia RTX™ for real-time ray tracing.
- The raising of Blockchain and Cloud Computing make Nvidia widely adopted.
5. Bitcoin, Mining age
- 2020: Bitcoin price raised to $20,000. The RTX 30 series was released.
- The mining age makes the GPU price doubled, trippled and even higher. 30 series are almost all mining cards.
6. AI, Big Language Model, Metaverse
- 2017: Google announced their
Transformer
model for LLM. See What is a transformer model - 2021: GPT-3, one of the largest language model, was released by OpenAI.
- 2022: The ChatGPT is publicly announce. The big language model is popular.
- 2022: NVIDIA Omniverse™ platform is released as fundational role of building metaverse.
- As the core infrastructure of training LLM, Nvidia is again on the top of the tide.
7. Today
Moore's Law is fading today. Now it yields Huang’s law — that GPUs will double AI performance every year.
The world's 6th largest company (Oct. 2023).
See World's Largest Companies
[Updates June. 18th, 2024] 😱 Nvidia is temporarily No.1 today.
Product Series
Nvidia had many product series, now it has 3 main series:
- GeForce: Desktop, Gaming e.g. GeForce RTX 3090, GeForce RTX 4090.
- Quadro: Workstation
- Tesla: Data Center
- See Nvidia Tesla. e.g. H100, A100, V100, etc.
- AWS Deep Learning instances are based on Tesla. See AWS GPU Instances
- Others: Jetson, Ada, Tegra, etc.
Anecdotes
1. NVIDIA naming
Nvidia's first chip was named as dot-NV
. "NV" is the abbreviation of NEXT, for they enjoy developing the next generation of products.
For corp name, they try to find a latin word with "NV" in it. They found "invidia" in Latin, the envy. They want to be the envy of the industry. So they remove the "i" and named the company as "Nvidia". 🤣
Actually, they did it.
2. NVIDIA vs. AMD ?
- Jensen Huang (黄仁勋) and Lisa Su (苏姿丰) are both Americans born in Taiwan.
- They are relatives. Su's maternal grandfather is the eldest brother of Huang's mother. Huang is the "uncle" of Su.
- Jensen Huang
- Lisa Su
3. The nick names
- Jensen Huang is called "老黄" and Lisa Su is called "苏妈" in China.
- Jensen Huang is more popular as "皮衣刀客":
- The "皮衣":
- The "刀法":
Card | 3060 | 3060Ti | 3070 | 3070Ti | 3080 | 3080Ti | 3090 | 3090Ti |
SM count | 28 | 38 | 46 | 48 | 68 | 80 | 82 | 84 |
VRAM | 12GB | 8GB | 8GB | 8GB | 10GB | 12GB | 24GB | 24GB |
Semiconductor etching is error-prone, especially for 7nm, 5nm even 3nm process. The yield rate is not high.
The chips are design to be error tolerable. Each area on the chip is standalone and can be disabled via firmware if there is an error. If the 84 SM chip has 2 SMs disabled, it will be written as a 82 SM chip and wrapped as 3090. 😆
4. The most popular CEO
- The rank voted by Silicon Valley employees in Aug. 2023
- Huang has a tatoo of "Nvidia" logo on his shoulder. (as he promised if the stock value reach $100)
- Huang made the correct decisions to push the Nvidia where it is now:
- Forsee to gaming market as a "Billion". Build chip for gaming.
- Persist technology innovation to iterate the GPU.
- Make GPU general-purpose, become the hardware arsenal of new era.