I played with it yesterday too. I had high hopes. And I have to agree that it looks ugly (Ubuntu 12.10/Unity here). Fonts are random, I don't understand how it picks them. It also insists on using its own baby blue background color to make sure it won't blend in with the desktop - this extends even to the app indicator with the same color background.
I don't have the somewhat irrational seeming Java hatred some people express in this thread. I don't really care that much what language an app is developed in, even if it's Mono/C# or Java. I just want developers to stop being special snowflakes and stop redesigning widgets or color schemes that clash with the rest of the system.
It's not impossible to create nice looking apps with Java. See Eclipse.