There are multiple kinds of 'smart'. The following section in Wiki breaks them down into IQ, emotional, social, and moral. https://en.wikipedia.org/wiki/Intelligence#Human
Historically, a lot of 'high IQ' people didn't necessarily 'fit in' to society. See the story of William James Sidis ... 'He entered Harvard University at age 11 and, as an adult, was claimed by family members to have an IQ between 250 and 300'.
Also historically, people smart enough to see that a lot of the world is about shuckin' and jivin' and not giving a crap? may not be not interested in playing the game. Some find other interests and don't see the point in 'accomplishing' things that will mostly be forgotten. Ramanujan had a HUGE talent for math ONLY, unrecognized until he wrote a professor halfway around the world.
We were all born without a manual. There are ways to enjoy life on your own terms.
Yeah! A lot of times, hanging around with people you share things in common with leads to friendships. In friendships you might discover a few more things in common. No worries ... if it's fun and the chemistry is good, the rest will follow.