Its been done:

http://openpandora.org/

.. and its getting a new revision:

http://www.pyra-handheld.com/

This is exactly the device you describe - powerful, complete, can be used in Desktop or handheld (or embedded) modes, open source, open community, no walled gardens or other limitations placed on developers ..