Music streaming now allows almost total access to the work of all recorded artists. With vinyl, you have to make a choice or you will need a warehouse.
So, vinyl is likely to be for your discretional treasured listening, backed by daily streaming, radio etc.
So; what should your vinyl selection strategy be?
The choice is yours, but it is suggested that you have one!
Buying ad-hoc over a long-term can easily result in several hundred or more albums, which begin to take over your available storage space. Unless you are particularly disciplined, finding albums will become increasing troublesome. Also, you will discover beautiful tracks and then lose them in your album swamp. You will eventually discover and purchase great albums and then find you already have them when you get home.
Some strategy ideas;
The entire work of a few artists
Can be very rewarding, particularly with artists like Herbie Hancock (from 1962 and still active). Consider not including live or compilation albums to narrow the task. Means you will acquire great albums, but also fillers. Lets you appreciate the journey of an artist more and discover unloved but remarkable tracks.
Select from the period of a record label
How about Stax Records 1957 to 1978, or Motown Records 1960 to 1972. Gives you the option to turn your sound room into a period set!
Top 100 albums of all time
As an isolated set within your collection, why not consider purchasing them all. There are many lists, for example The greatest vinyl records of all time by Liz Lentini. Nothing after 1991 and no novelties, special collector releases etc. It will not be entirely to your taste, but such work is sometimes accompanied by a beautiful reference book.