If you have never gardened before or are unsure of how much of a commitment you want to give, you should start small. I would suggest staring with an herb garden. Most herbs can be grown in containers and are pretty fuss free. You can even grow them in the house near a sunny window. Most people like to grow herbs in containers on a kitchen window sill.
Now that you have decided it might not be such a daunting task, you are probably wondering what herbs you should grow. My suggestion is to grow common cooking herbs. Basil, rosemary, oregano, thyme, sage, and parsley are all easy to grow and common in cooking. Any or all of these herbs would be a good choice to begin your garden.
The other method of planting herbs is to use transplants. This is more costly but faster and easier. With this method you would just set the plants out on the window sill and transplant them into larger pots as needed. You could also wait until after the last frost and plant them in your yard. They make beautiful garden plants, don't take up much room, and can be used in any landscape. Just plant amongst your other plants. Just make sure to label them so you can remember which herb is which. When you are ready to use your herbs in cooking try some of these recipes at fresheasymeals.com. You can find seeds and transplants at seedsavers.com or sustainableseedco.com.
There is nothing stopping you now. It's time to get started. Good luck, and come on back for more tips on growing an edible backyard.