There are different ways to low carb'ing, making it difficult to put a precise definition but all concentrate in eating non processed nutritionally dense food.
To put it into perspective: it would require over 500g of broccoli, spinach, mushrooms, lettuce, avocado, pumpkin, asparagus, kale, courgettes, olives etc. to eat the equivalent of 1 cracker worth of carbs. Nutritionally, the veg has essential vitamins, minerals, fibre...a cracker is, at best, nutritionally void and it's a highly processsed food (flour, sugar, vegetable oil, emulsifiers, stabilisers, anti-caking agents...).
If you are hesitant about jumping in with two feet, how about starting with a softer approach by eliminating flour products (bread, crackers, pizza, pasta, cakes, biscuits...) and sugar (including fruit juices, squashes, flavoured water...)?