Is it worth it to transfer?

I am currently a freshman at Clarkson University in Potsdam NY and I'm not sure if I reealy enjoy it here. The campus here is not beautiful to say the least and the school is only like 20% female. I mean i like being here, but im not loving my college experience like all of my high school friends say that they are else where. I have a 4.0 (only through 1 semester) and in highschool I had a 3.77 gpa and got a 1280/1600 on my SAT's. I play on the rugby team here and I've made a lot of friends but I cant stop thinking that I would be happier else where. The main reason I choose thi school was because I recieved a very good scholarship. I have been thinking about transfering to a bigger school in better weather, like UVA Vaderbilt or Duke, but im not sure if I'd be able to aford it nor do I know if I would really like it any better than I do here. Would it be worth the effort and expense to try to transfer?