Glass is not that fragile. We've been using tempered glass bottles (the fancy lifefactory ones with a silicone sleeve) for more than a year and have yet to break one despite many drops onto floor, pavement, etc. Cost is a little higher than plastic, but absolutely down in the noise when looking at total costs of having a kid.

I think we spent ~$150 on bottles, nipples, and tops; Including lids for these bottles to covert them into a sippy cup. There are cheaper tempered glass options available. Glass also doesn't age like plastic--our stuff has many more years of useful life in it.