A domain name is the name that people use to view your site in a web browser. Here are some examples:
You can reserve a domain name (e.g. mydomain.com) for about $10 per year through a domain registrar.
I use NameCheap and have been happy with them. They have a coupons page, and often include good discounts for new customers.
Next: What is web hosting?