I guess private tech companies are called "startups" for very long time until either they go public or they are so big and old it doesn't make sense to call them startups anymore.

One example would be Kingston Technology which is private and over 30 years old with $10bn of revenue.