Start following art groups and associations in your local area and on-line (water colourists, equine painters, landscapes, seascapes, youth collectives, student shows, etc) whichever catches your interest, and start going to vernissages and exhibitions and get your eye in.
The art world is quite small and you will gradually start seeing the same faces if you are a regular attendee. If you are worried initially by going alone, start by taking a friend, but I have had more luck talking to people when I go alone! People love to talk about their own art or their purchases.
At the same time maybe read some good books on art history on all the different eras, styles and schools of art. I can recommend some if you are interested. And visit as many public galleries as you can.
Start going to antique fairs and study auction catalogues.
And then start making a few modest purchases while you find your style! Don’t try and buy something that matches the furniture, buy something you love!