Personally I think they are a waste of money, overall at least in the long run... They do have the advantage that they are a cheap starter option as the IDE and compiler are free, but that cost diminishes very rapidly as you create and implement new designs that don't require the Arduino platform...
They have GREAT support forums but the scope is so focused and limited to a single platform...
I'm of the opinion that those that really plan to stick with it should start with a foundation that you can actually progressively build upon and the Arduino platform lacks this...
I primarily lean towards PICs and only dabble in AVR designs, but I do know with WinAVR studio and a cheap programmer you can jump right into the entire AVR lineup, from 8 pin up to whatever... You won't be stuck using a $30 - $60 Arduino to blink an LED, instead you can use a $1 chip and a few pennies in support components to build your design...
If you want a simple plug in and go USB development module, look at the real Teensy USB, write your code with whatever compiler and load it into the Teensy with USB in a flash... Like the Arduino this is building upon a single platform though, and again no need for a $16 module to blink a few LEDs...
For me cost isn't so much of an issue since I can factor it into the small projects I do flip for a profit every once and a while... PicBasic Pro for me was worth every penny as I have been writing BASIC for about 30 years now, I took to it like a fish to water... It's not the most elaborate compiler and it has it's issues, but since all my other devices like programmers and development tools are not device specific I can switch to other compilers without any issue, just dump the hex from any compiler, burn and run it all the same... PicBasic Pro also has a ton of online support in their forums, the fact that it emulates the BasicStamp syntax also means that for the most part BasicStamp support applies, or at least you will be able to snag code snippets without huge porting issues...
But, language choice is yours... It's clear in todays world that the C language is the preferred choice, so if you want to jump from AVR to PIC to ARM to whatever it might be best to start with C and forget Basic...
Edit, BTW I do own a Ardunio, and I do tinker with it since there is a ton of already written code that is fun to play with... But, at the end of the day I will re-write or port my code to different chips and boards of my own design... Many of my designs simply do not need say a 28 pin micro, and there is no reason to waste a development module on a finished design like I see many do with the Arduino...