Why Wayland is good for the future of Ubuntu, Canonical, etc.

History
 
The recent announce at UDS about the fact that the venerable X server & protocols will not be the default choice for Unity and as a consequence Ubuntu was a shock for some, it is clearly a relief for me.

In my precedent post about Unity, (before the UDS/Wayland announcement) I said "In this context, Ubuntu/Canonical is more conservative than Apple and Google that decided to dump X altogether. I'm not sure the X environment is fitted for next millennium challenges : once again, time will tell."

Obviously, the X server and protocol are great tools, very mature and with numerous capabilities. For a long time, evolution was slow, some would say "frozen" but then X.org did a great job and things started to evolve again.

However, being in the field, deploying X-based thin-clients since 2003 and designing larger scale and user friendly open source thin client solution (LTSP-Cluster) made me wonder if this was a protocol fitted for the future.

Why not X ?
Without being a X expert, some of the issues that were critical in the (announced) move from X server to Wayland

Hardware support : I strongly recommend to run Linux only on hardware with a well supported video driver : without a well supported driver, the experience can be daunting, especially on a thin-client. X was supposed to be hardware independent, lightweight and provide great performance.

However these fights had been lost long ago : I've learned the hard way that not all X drivers are equals : open-source or not, how many XV channels are supported, 3D (what version exactly, etc.). In fact, selecting good quality desktop or thin-client hardware is a service we sold to our customers !

Size matters : a default X.org server, on my desktop where I wrote this blog is 64Mb (without cache), 180Mb (with cache) on a Ubuntu 10.10, 64 bit with regular 3D effects. Well, on a phone with 256Mb or RAM or on an ARM based thin client with 64Mb, this is not good. I can imagine it also has an impact on battery life on the mobile devices.

A toolbox instead of a simple tool : Without being "bloated", it is certain that X has evolved, along the year, to support a huge number of hardware, protocols and has a long history and has a load of quirks and "this is not a bug, it is a feature" type of functionality.

Crispiness : X is not very crisp. Without being a usability expert, I can guarantee that, in my experience on iPad, Mac, Android device, those devices are much more responsive graphically than your average Linux desktop. Why ? I'm no X expert but I will propose the hypothesis that this is because of the legacy of the project.

3D : Without discussing the time it took to obtain 3D support at the X level, remember the Compiz/Beryl/Looking Glass and the time it took for them to mature while most of the X user where despising the efforts ? How well is 3D integrated into your desktop environment ?

Why Wayland ?

Most of the reasons don't have anything to do with Wayland and are consequences of the present IT competitive environment, the current state of X as well as business needs.  In this context, we will see that Wayland happened to be exactly what was needed : instead of starting from scratch a start-up project, hosted by freedesktop.org, an existing proof of concept and prototype, an already existing but small community with the goal to improve user experience.

My first reason is a practical one : I think that in order to make X evolves to a state suited for Mobile Internet Devices (MID) it request a deep technical knowledge of X as well as a long time to really convince all the X shareholders to agree to a change. Will the market wait for this change : I'm sure it will not ! Will everyone agree to the need to change : not certain either. Can a company accept this level of risk for what is their future ? According to Wikipedia, X11 dates back to 1984. Is it possible and wise to compete in this space with a technology that is 26 years old : I really don't think so (I'm saying this with a profound respect to everybody that contributed to the X11 project : the fact that it was great for 20+ years, in IT, is clearly a tribute to the design and the project itself).

Another way to look at this is the "disruptive innovation" or "disruptive technology" model. Mobile Internet Devices are changing the IT world ... big time. Major players are on the verge of becoming irrelevant in a new market that is growing faster than any other market in IT. Think about the position of RIM, Blackberry, PalmOS, Microsoft, etc. in this market space ? Others are sizing (creating?) the opportunity and went from losers/non-existent to key players (Apple with the iPod, iPhone, iPad and, of course, Google with Android). In order to compete in this space, legacy has to be left behind : your average MID does not share a lot in common with your desktop : UI of every single application has to be re-designed in order to take into account : screen size, touch screen, multi-touch, no mouse/keyboard, battery consumption, etc.

Wayland goals are the following (according to Wikipedia) "every frame is perfect, by which I mean that applications will be able to control the rendering enough that we'll never see tearing, lag, redrawing or flicker".

Well, in term of goal, it really puts the user in the center of things : a display manager that provide a great user experience. Ubuntu is popular on the desktop because it really put efforts into design and decided to place the user in the center of things.

Conclusion

Well, it is always interesting when a decision you were expecting happens. In a sense, I'm pleased and excited because it is the only way to compete and provide an open-source solution in the MID market and, why not, somehow piggybacking on the desktop market.

While Android could have been a possible choice, choosing Android will have constraint Ubuntu/Canonical to ... follow innovation, not to drive innovation. Also, Android has some issue, especially if you value the open-source development model where all the doors are open for the community to join and participate.


All in all, my only reserve is with the timing : if Wayland is ready in one year from now, it means a 2-4 years of delay compared to, let's say, Google and Android. More than this with Apple. In this context, the question is : Is it too late ?

Evolution and revolution are and will be needed in order for Open Source to continue to be relevant. This is particularly true in a disruptive market like the MID market. The announce was certainly a great way to launch one. History will tell if will succeed : I really hope it will and I really encourage the Open Source community to see the big picture out there, regroup and, ultimately, to contribute as much as possible to Wayland & Unity in order to make it a first class open source citizen able to run on any MID device and on any desktop.

Why Unity is good for the future of Ubuntu, Gnome, Canonical, etc.

Desktop and windows manager

A few month ago I already blogged about "the end of the (Linux) desktop as we know it." I will not blatantly repost this entry but draw some conclusions linked to the recent adoption of Unity for the default Ubuntu desktop.

My conclusion was the following : "At a certain level, one can say that the battle is already lost : the current desktop environments can not really fight this war as they don't own the key technology : the browser. As a consequence, the risk, for them (Gnome, KDE, etc.) is to be a tool that will launch a browser. A (relatively) simple tool that can be easily changed with almost no user impact..."

The recent announcement at UDS confirm that this road is the one chosen by Ubuntu. Now the question is why and what benefits for the key players here : Canonical, Ubuntu, Gnome and, of course, the users.

Mobile Internet Devices (MID) = application delivery

The new hardware platforms (most of them ARM based, touch-screen based, with small screen and no keyboards) rely extensively on the cloud/web based application and deploy specific small size applications on every connected MID.

The "desktop" on those platforms is very different from the one on your regular  "old-school" computer : it consists mainly of giant dock with widgets and your most used apps and a task-bar that informs you about communications (tweet, email, voice mail, etc.) and the MID status (wifi, phone, battery, etc.).

Most of the regular desktop applications are barely usable on such a device : do you think that Open Office user experience will be great on a 640x480 screen with no keyboard ? All those applications are now somehow "legacy" and given the specific user interaction with the MID and the MID capabilities (touch screen, multi-touch, accelerometer, low computing power, etc.) can not be used, with a great user experience, on those devices. Even the most "cross-platform" software, the browser, is specific to the MID device and every major player rolled out a specific version (lighter, snappier, etc.) for those platform.

So can we use the legacy application, yes. Will they succeed "as is" on those MID : I don't think so.

Can a MID platform succeed on the desktop ?

Well, this is the interesting question. Ubuntu/Canonical decided to bet on it. In fact, instead of synchronizing your desktop to your MID, why not consider your desktop as ... a very large MID ?

Apple did it the other way around, Microsoft as well bu they both come from the old desktop world. Google did it from Android for MID to a hypothetical GoogleOS that will certainly be very similar to your Android experience.

Ubuntu/Canonical is betting on the fact that users will follow them from the MID market to the desktop market. This is an interesting challenge and a really disruptive choice : let's break compatibility with the past and embrace this new way of delivering applications.

Will it succeed : only time, users and the market can tell ;-)

Impact on key players : gnome, Ubuntu/Debian, Canonical, users

Well, as I announced it in my precedent post, the legacy of the desktop environment out there is too cumbersome to carry on this new trendy market. Nokia (QT, Symbian, Meego) , Google (Android), Apple and Canonical came to the same conclusion : they can not build on top of those legacy windows environment (most of the time : because they have to serve a community of developers and users that care only about the "old" desktop model) : they had to start from scratch for the user interface. However, they kept some very useful and precious components like the kernel, basic OS, etc..

In this context, Ubuntu/Canonical is more conservative than Apple and Google that decided to dump X altogether. I'm not sure the X environment is fitted for next millennium challenges : once again, time will tell.

Gnome : I think this is a great news. Leveraging the tools, library and previous applications, a new "shell" can be developed that will be perfectly suited for MID. This, I can imagine that innovation can flow more freely from Desktop to MID and vice versa. Will Gnome developers embrace this change ? Will it provoke a community meltdown ? This is more an ego risk than a technological or business one. FLOSS is famous for its ego war and this may be the greatest risk for this key-player.

Ubuntu/Debian : Well, this really open another market for this distribution. A strong differentiator compared to RedHat, Novell. Competition on this market is called Android. Not an easy one to take on...

Canonical : As far as I know, the OEM division will have another great product to sell ! Just look at sales figures from Apple and Android device. This look very interesting to me. As the third or fourth player (Apple, RIM, Google, ...), becoming leader in this market will be a real challenge. Two very closed platform, two very open platforms. A huge and very fast growing market.

Users : Choice is always beneficial to some degree. As the default desktop environment will change, we will see the adoption rate but I expect it to be quite large in the Ubuntu community. This is a well known tactics (anyone remember Microsoft embedding IE into the desktop ?) that has worked well in the past. Also, it will help "convergence", namely the unification of your desktop and MID environment ... through the cloud services that will be offered on this platform (Music, More content, Storage, Contact, Preferences, ...).

Conclusion

All in all, I think this is great news for the future of Linux and all the involved party (Gnome, Ubuntu/Debian, Canonical and Mr. User). My only concerns are linked to some possible ego-war into the Gnome community and the fact that this will "only" be a tertiary platform in term of applications and content delivery : RIM seems in trouble, Apple the clear gorilla and Android the strong challenger. Will the great marketing and community/viral effect of Ubuntu be able to modify the race results ?

The end of the (Linux) desktop as we know it ?

Embedded Linux : common trends

More and more of the Linux ecosystem (PC hardware vendor, phone hardware vendor, search engine giant and more recently a well known Linux distro, Ubuntu) uses Linux as an embedded system for the desktop. Some examples to illustrate this trend :

• Asus Express gate embed Linux in the motherboard. You can have, in a few seconds, a browser, skype, etc.
  
• Google Chrome OS : not yet released but it is define as the Web OS with a minimalist/zen approach (like an OS based on Chrome, the browser)
  
• Mobile platform : you'll have plenty to choose. ARM based : Symbian, Meego, Android, etc.
  
• Last but not least, Canonical announce "Unity", a minimal/Zen OS that will be available to OEM but can be nonetheless deployed on Ubuntu Lucid and later.

Major desktop environment (Gnome, KDE) : things of the past ?

One interesting Linux specificity is the fragmentation of the windows manager market. No other "mainstream" operating system has such a complexity : the window manager is unique and completely integrated (from kernel to applications) into the Operating system. Thanks to the XFree standardization, Linux is more complex : several window managers exist and have to co-exist.

However, on this level, things are changing rapidly :

• Collaboration between Gnome, KDE and XFCE (and others) is accomplished with the Freedesktop project. The project goals are to define common tools (like X.org), sub-systems (Dbus, etc.), API to ease integration and interoperability of the different window manager.
  
• Zen-ification : Simple is beautiful. Minimalist systems set the trend. Clunky interfaces tends to disappear and are flagged as bad design. Esthetic and ergonomic are the two main change drivers. Simplicity is especially important in order to "cross the chasm" and reach the general public.
  
• Cloud computing : Browsers are the key to the world these days. An interesting point to notice is that none of the desktop environment are relevant in the browser war : they use/integrate a major browser based on user choices (OK. they provide a browser but ... those browsers do no exist on the larger scale of the Internet!).

Negative impacts for the (Linux) desktop

• With the cloud, more and more users will be completely satisfied with a browser. As a consequence, users are more likely to care about their browser and the associated information (bookmark, session, password, cookies, etc.) than about their desktop. Major browsers offers a form of cloud synchronization : Mozilla Weave and Chrome Sync (with a google account ... of course) are leading the pack here. Those tools contribute to free the user from the desktop : everything can reside in the cloud.
  
• Even if a desktop is less and less relevant, migration from 100% local applications (PC) to a 100% cloud will take time. During this time, a desktop is still needed but this is an end-of life situation for this product line. The fact that major players roll out their own desktop environment is a sign that current desktop environment do not meet the needs of the future. Instead of improving the current ones, major organization decided to ... create their own. Asus with Express Gate, google with Android and soon Chrome OS and, more recently, Canonical with Unity.
  
• The direct consequence is a form of "commoditization" of the different desktop environments : they all look alike and most "regular" users don't really care. The differentiation factor is small/difficult to point out : only style, look and feel is experienced by the user after all !
 

 

Positive impact 

• Linux everywhere : after the servers, here come some form of "desktop". The platform is now very popular and we can see convergence between mobile phones, netbook, mobile internet device, etc.
  
• Hardware support ... will become better and better on the "desktop". As more and more hardware manufacturers provide an embedded Linux, hardware support will become a non-issue. Most components are standard and this will lead to a well supported platform for the desktop.

Conclusion ?

The value is shifting from desktop environment and desktop applications to browser and cloud applications. The direct consequence is that the Linux desktop environments should unite and work more closely together in order to address this need.

This will not be an easy task as lot of flame-wars and ego-wars will have to be resolved : the feud between the different windows manager is long-lasting and not really decreasing. Key projects like Freedesktop are very important in this regard.

Major players created their own "non-desktop environment" to provide a zen-minimal environment that contain a browser and some additional technologies (video-conferencing, etc.). Those players decisions should be a serious wake-up call for the window managers : a major hardware manufacturer, google, an open-source friendly distribution editor (Canonical with the recent Unity announce) decided to create their own "desktop" environment. Those products will be delivered to millions of users...

At a certain level, one can say that the battle is already lost : the current desktop environments can not really fight this war as they don't own the key technology : the browser. As a consequence, the risk, for them (Gnome, KDE, etc.) is to be a tool that will launch a browser. A (relatively) simple tool that can be easily changed with almost no user impact...

Ubuntu : I am because we are (book review)

When I noticed this book in Washingon Dulles airport, as a Ubuntuer myself, I did not resist the urge to buy it ;-)

My initial understanding of "Ubuntu" was the one stated on Ubuntu Site : "Ubuntu is an African word meaning 'Humanity to others', or 'I am what I am because of who we all are'. The Ubuntu distribution brings the spirit of Ubuntu to the software world."

As such, I was already genuinely interested by the subject and surprised that it was a much more complex and structured philosophy than I expected. For more on this subject, please consult Wikipedia Ubuntu_philosophy page.

The book is very easy to read and lightweight : this is a kind of initiatory novel where the hero evolves from a stressed, social hurt, on the edge of loosing his job because of work-induced problems (recent evolution to a managerial job, overtime, no family life/divorce, etc.) to a much more ethical and peaceful state of mind. The company will be transformed as well by this philosophy.

The change agent is a young man from South-Africa that happens to embodied the Ubuntu philosophy : he _is_ Ubuntu ! The large corporation where all the characters are working is in a difficult position : the financial crisis is partly in cause and the ethics and core values are not shared anymore by the employees. Business units operates independently and everyone wants to reach its objectives without consideration for the other humans and business units.

The Ubuntu philosophy is explained, on step at a time, and it is truly revealed when, a team is visiting South-Africa thanks to a HR department contest.

But what is Ubuntu ?

Instead of citing passages of the book, I will refer to the Wikipedia Ubuntu_philosophy  page :
Archbishop Desmond Tutu further explained Ubuntu in 2008:

One of the sayings in our country is Ubuntu - the essence of being human. Ubuntu speaks particularly about the fact that you can't exist as a human being in isolation. It speaks about our interconnectedness. You can't be human all by yourself, and when you have this quality - Ubuntu - you are known for your generosity. We think of ourselves far too frequently as just individuals, separated from one another, whereas you are connected and what you do affects the whole world. When you do well, it spreads out; it is for the whole of humanity.

I have found numerous common point with Buddhism (that I practice) in particular the respect ("don't be evil") and interconnection of every human being (but not only!).

This book is very easy to read and very inspiring as it reunite the "evil" corporate world (especially since the financial crisis) with a more ethical world. While I compare Ubuntu to Buddhism, the book is not religious or even philosophical : the wisdom of Ubuntu flow slowly as the book plots and characters appears. They progress along the path as the reader discover the Ubuntu philosophy.