OpenNMS Newts at ApacheCon Europe

October 24th, 2014

Being Hungarian, I am very jealous and yet still proud that our very own Eric Evans will be presenting at ApacheCon Europe in Budapest, Hungary.

He will be talking about Newts which is a new time series data store built on top of Apache Cassandra. It will be a key part of positioning OpenNMS for the Internet of Things as well as being very useful on its own.

Eric is a dynamic and interesting speaker, so if you are attending the conference be sure to check out his talk.

And while you are there, eat a Túró Rudi or three for me.

Alinea

October 24th, 2014

Note: This is a travel/food blog post with no OpenNMS content. As usual, feel free to skip.

I consider myself insanely wealthy. Not in terms of money, most people could always use a little more, but because I’ve managed to meet some truly amazing people in my life, and even better, there still seems to be a nice supply of them. My life has been greatly enriched because of it.

One such person is Geoff Davis, who I met in high school (he was a year younger but in all my advanced courses) who now works at Google. The last time I was out there he and his bride took me to dinner in the Mission, and while we were talking about food he mentioned the Alinea.

The Alinea restaurant is located in Chicago, and it is one of only thirteen (when I booked it was ten) Michelin three star restaurants in the country. I happened to be in Chicago this week, and as this trip was planned months ago I was able to book a table for six. The experience was pretty amazing.

The name comes from an archaic mark similar to the “paragraph” symbol: ¶. The alinea looks more like an inverted “D” with two vertical marks, and in the name of the restaurant it represents “a new beginning”.

The booking process was unique as well. I like to cook, and occasionally (very occasionally) after one of my better efforts, someone will say “you should open a restaurant”.

Hell no. Owning and running a restaurant is incredibly hard work. People who aren’t into food (and some who are) just don’t realize it. Part of the problem is that people have few qualms about either canceling a reservation at the last minute or not showing up at all.

The Alinea addresses this by selling tickets instead of taking reservations. I’m not sure it would work for every restaurant, but when you have a place with a) high demand and b) a prix fixe menu it seems to work well. There is a long discussion of the history of the ticketing system available so I won’t repeat it here, but it did resonate with my innate fondness for unusual business models.

The restaurant itself is very non-descript. Most of our party met at Boka next door for drinks (an excellent restaurant on its own right with its own Michelin star). I probably wouldn’t have known where to enter the Alinea if I wasn’t shown the way.

You enter in via a dark corridor highlighted by red lights, and it seems to narrow a bit. When you reach the end you are greeted by what I would come to recognize as the level of service that helps the Alinea keeps its stars. For our group of six there were at least three people there to take our coats. One pair in our party had arrived with their car, so the staff took the valet parking slip to make sure the car would be ready when it was time to leave. We were served by no less than twenty people during the evening but it was perfect – they were there when you needed them and quickly gone when you didn’t.

We were shown upstairs to our table. The restaurant only accepts parties of two, four or six. Party of three? You buy an extra ticket, and since they are quite spendy my guess is you’d find an excuse to invite Aunt Edna out for the evening.

Just a quick note: I wanted to immerse myself in the experience so I took no photographs or notes. I might get some of the details wrong so I will apologize in advance since my memory isn’t what it used to be.

Our host Miguel, I would not call him a server even though he did serve us food, welcomed us and explained how the evening would play out. We were to have 15, maybe 16 courses and there was an optional wine pairing. He stressed that the wine servings were modest and that it would end up being about four glasses of wine total. The “maybe” 16th course was a special: white truffle risotto. When I visit my friend Antonio in Italy (another amazing person who has enriched my life) I always tease him about this very expensive food. When he asks what I want to eat I say “tartufo bianco”. I love truffles but as Cat, one of our dinner companions, pointed out, having such an extravagant course here would be like gilding the lily. Plus, the $150/person cost put it out of my league – I had to cash in my Christmas and Birthday presents to swing the dinner alone.

I got excited when they prepared to bring out the first course. They placed little white pillows on the table in front of each of us and on it was a caviar spoon (I love fish eggs of any type). Miguel explained that the silverware we’d need for each course would be placed on the pillow and that we were to leave the used items with the serving dish in order to keep the pillow clean for the next course.

Speaking again of the crazy level of service, if one of us got up to use the restroom, one of the staff would immediately remove the napkin and replace it with a fresh one. Cat explained that napkins are meant to be used, and no one should have to come back to a soiled one. Crazy, but cool.

The first course was Osetra caviar served with a variety of other flavors. I was not going to do the wine pairing, but I agreed to start off with a glass of champagne (Pierre Moncuit Blanc des Blancs Brut NV) as did Ron (what else do you pair with caviar?). Demetri and Cat did get the pairing, while my lovely bride Andrea ordered a glass of Riesling and Colleen stuck with water.

The caviar was delightful.

The second course arrived in the form of two large “tumbleweeds” made up of intertwined brown vines. Each was about twice the size of a basketball. We were told we had to find the second course hidden within the branches. In each ball was hidden a piece of salsify, a root vegetable that had been cooked sous vide and heavily seasoned. It matched the color of the vine exactly but had a much softer texture. It was tasty, although this is one of the few places I’ve eaten where you had to ask yourself “is this bit the food?”.

The third course was skate, cooked sous vide and seasoned with brown butter, lemon and herbs. The paired wine was an A.J. Adam “Dhroner” Riesling (Mosel 2012). I made a joke about “Dhroner kebabs” that fell flat. Demetri had me taste some of his and I liked it so much I changed my mind about skipping the wine pairing. It was the most tender skate I’ve ever eaten, and it makes me want to explore sous vide cooking even more.

Course number four was ebi, or sweet shrimp for those of you who like sushi. It was paired with Muscadet Sevre et Maine “Granite” (Domaine de l’Ecu 2010) which I found to be too mineral. I remember liking this dish but I don’t remember too much of the details, since it was eclipsed by …

Corn. The fifth course arrived served in roasted corn husks, causing me to remark “look, the world’s most expensive tamale”. It was far from a traditional tamale. The corn was whole, roasted and served over a bed of creamy grits. The whole thing was seasoned with truffle, manchego cheese and sherry. Think about how much corn you have eaten in your lifetime – this redefined it for me. We were told that this was the next to last night it would be served as the seasons were changing. When asked how they were able to get the corn off the cob yet have it hold its shape, the secret is that the whole cob is dipped in clarified butter so that the kernels can be sliced off but still stick together.

The sixth course arrived on pieces of wood that used to be barrel staves. It was trout in white pepper, coriander and broccoli. Outside of eating off a stick (we asked and were told the staves were cleaned in the dishwasher and then burnt with a torch) in the middle were pieces of bone – a small bit of spine and the plate near the cheek of the fish. We were told that, indeed, this was food. It was surprisingly tasty, although I think I cut my tongue a little on the spiny bit. This was paired with a Chablis (Laurent Tribut 2011) that I quite liked.

Flowers made up the seventh course, mainly lilies, with rambutan and a caviar lime sauce.

Now at the halfway point, the staff brought out two stone plates topped with pieces of wood. They set these on fire, and the smoke and light added a nice ambiance.

Course number eight featured matsutake mushrooms, which I adore. It was served with a number of sweet flavors, including a huckleberry foam and tapioca. In keeping with the Japanese association with this food, the pairing was sake, Tensei “Song of the Sea” Junmai Ginjo-shu (Kumazawa Shuzo, Kanagawa-ken). I loved the food but just liked the sake (I’m pretty particular about sake).

The ninth course was a bit of a surprise. The wood/fire centerpieces, which had now gone out, were dissected and out of them came our food. It was charred pork belly served with compressed parsnip. Yummy. It was served with our first red of the evening, Donkey and Goat “Testa Vineyard” Carignane (Mendocino 2013), which was very nice.

Dish number ten was also unusual. It was a warm butter-based broth served in a small, concave bowl made of wax (it reminded me of nothing less than a huge contact lens). Suspended above it on a steel pin was a piece of potato and truffle. You were told to pull the pin, causing the items on it to fall into the broth and then eat the whole thing in a shot. Tasty, but I spilled a little of mine. I believe it was on the table for about 450ms before someone had wiped it up.

The last mainly savory dish of the night was squab. Served on a piece of dark wood that looked like the top of a tree trunk, the roasted squab was served with carrot, potato, beet and an orange sauce. There was also a piece of squab liver as well. The pairing was another red, Valpolicella Classico Superiore (Tomasso Bussola 2009) which complemented the meat well.

The twelfth dish started the transition to sweet. Called “graffiti” it was a hazelnut candy, like a praline, served with balsamic vinegar on a matching piece of gray stone. This was the only misstep by the staff. Ron doesn’t like balsamic vinegar but they missed his request not to spray it on. I like balsamic but this dish was only “good” for me. The pairing, however, was a Vergano Chinato Moscato “Luli”. Lately I’ve become enamoured of sweet dessert wines like Sauternes and this Moscato was delicious. I’ll seek it out when I get home.

Probably the oddest dish (in an evening of odd dishes) was dish number thirteen. Featuring blueberries, part of the dish was a foam made from Bubble Yum™ chewing gum. I double-checked to make sure we could eat it. Believe it or not, it really worked. The pairing was another Muscat wine, Jorge Ordonez “Victoria” (Muscat, Malaga 2013) which I liked considerably less than the Vergano, but it was still good.

If you read about the Alinea, you’ll often see pictures of transparent white balloons. That was our fourteenth course of the evening. Made with a green apple candy, the balloons are served filled with helium with a taffy string. The way we would told to eat this was to try and suck the helium out of the balloon and then talk. Yes – fun with food. It is this kind of whimsy that made the evening worthwhile, and the fact that in the end you could eat pretty much everything was also a plus.

The final course was the most elaborate. We all moved to one side of the table which was then covered in a large rubber sheet. The head chef himself, Grant Achatz, came out and using about 15-20 small dishes painted our final course directly on the table. It was a combination of tropical fruit flavors. There was mango, passion fruit, compressed melon, a coconut meringue flash frozen in liquid nitrogen, a kaffir lime “candy” with edible wrapper, roasted banana, pineapple – and I forget what else. The chef was professional if not extremely outgoing. I was so busy watching him and his associate work (the table size required two people) that he was there and gone before I knew it.

The final wine pairing was a Passito di Pantelleria (Fernandes 2006) which I honestly can’t remember. It was at this time I first looked at my watch and realized that four hours had passed.

Leaving the restaurant was as efficient as our arrival. Not only were our coats and bags waiting for us, so was Ron’s car and two taxis for the rest of the group.

If you are into food and can make it to Chicago I can highly recommend the Alinea. Better yet, if you have some amazing friends like I have in Ron, Colleen, Demetri and Cat (plus my BFF Andrea) it will be an experience to remember. Yes, it is pricey, but one of the keys to happiness is to buy experiences and not things.

In that realm I am a very rich and happy man.

Internet of Silos

October 22nd, 2014

My friend Phil sent me a link to a Gartner article listing the “Top 10 Strategic Technology Trends for 2015” and I wasn’t surprised to see the “Internet of Things” at number two.

Now that mobile computing has become ubiquitous, there is a rush to network connect everything. Plus, there is a lot of money in it – take a look at the Nest acquisition. I’m not really certain this is a Good Thing™. My experience with low end network devices shows that corners that can be cut often are (i.e. crappy SNMP agents) and my guess is that in this rush to get things out the door we will end up with some serious issues.

One thing that can circumvent this is open source. By making the code transparent, especially for medical devices, there is a strong chance that major issues could be identified and corrected.

If, and that is a big “if”, we could get people to standardize around various open source software for the IoT there is a chance we can prevent the “Internet of Silos”. I first heard that term in a BBC article where it was announced that ARM (a British company) was creating an open source programming language for devices powered by its chips.

As you might expect, the article was short on specifics, but if the language is any good and the license is permissive, perhaps other chip manufacturers will port it. At a minimum it should encourage companies like Intel to also open source the technology used for their chips and the community might be able to build wrappers around both of them.

No matter what happens, we hope to support any management capabilities they introduce. We are actively working on making OpenNMS almost infinitely scalable to be able to handle the needs of the IoT, from insanely fast data storage (Newts) to highly distributed polling and data collection (Minion). We hope that the open nature of the platform will encourage more and more product vendors to use OpenNMS for their element management system, and then at least on the management front we can prevent the silos.

Conferences? We Got Yer Conferences

October 19th, 2014

This is my “oh” face

as in “Oh how awesome is All Things Open”.

Last year was the first edition of the All Things Open conference in Raleigh, NC. I was very happy that we could be a sponsor, and the above picture was taken during my talk.

We ended up with about 50% more people than were expected, and the keynotes were standing room only. It was really cool to see such a turnout, especially since it sort of validates the Raleigh area as a center for open source excellence.

This year we will have a booth where you can come by, get some OpenNMS swag, and hear about the pending release of OpenNMS 14 (yes, fourteen) which is only a few days away.

Now, “oh” could also mean “oh-hi-oh” as in the Ohio LinuxFest. Directly after All Things Open, the Ohio LinuxFest will be held in downtown Columbus this weekend. This has been one of my favorite open source conferences, and it looks like this year is going to be no exception.

Unfortunately, I will not be able to make either of those shows due to another commitment. But if you want to see my “oh” face in person, come to the “Oh Ess Em Cee” conference in November.

Last year all three conferences were held the same week, which was very disappointing for me as it was hard to choose which to attend. This year the Open Source Monitoring Conference was pushed out a month and will be held in Nürnberg, Germany, 18-20 November. While mainly thought of as an Icinga and Nagios conference, the organizers have been very inviting of other projects. We have had a presence there for the last couple of years, but I have only personally been once and it was amazing. So many people sign up that they are able to pretty much rent out an entire hotel, so while the conference is always good it is the conversations outside of the presentations that are the most enjoyable.

I’ll be giving a talk on OpenNMS (‘natch) as well as getting up to speed on what else is going on in the monitoring world.

I hope you can make at least one of these shows. You won’t regret it.

Why There Will Never Be Another Red Hat

October 13th, 2014

My friend Nick sent me a link to a post called “Why There Will Never Be Another Red Hat: The Economics Of Open Source“. It immediately pushed a bunch of my buttons before I read the first word of the article.

First, it was from TechCrunch. I have nothing against TechCrunch and I respect a lot of their work, but they are Silicon Valley-centric, if not the main mouthpiece, and thus I have to take that bias into account when reading their articles. What works in the Valley doesn’t necessarily translate to the world as a whole, which is why a lot of Valley companies seem to quickly plateau after an initial success.

Second, continuing the theme of Valley biases, I strongly believe Red Hat doesn’t get the respect it deserves because it is headquartered down the road from us in North Carolina and not California. There is a strong sense of “you can’t make it if you aren’t here” in the Valley and that extends to a somewhat dismissive view of Red Hat. Plus, I have a big ol’ man-crush on Jim Whitehurst as he is the most successful tech CEO I know that really, really “gets” open source and thus anyone trying to tell me about the “economics of open source” without respecting Red Hat starts off on my bad side.

Finally, the author is currently at the VC firm Andreessen Horowitz, or A16Z as those of us in the know refer to it. In last year’s investment tour I met with a large number of people in the Valley, and the guy I met from A16Z was easily the worst of the bunch. He made the caricatures of the Silicon Valley TV show look mild. He had no interest in us since we weren’t in California and he was more concerned with who we knew than what we did. I left that popularity crap behind in high school. Granted, we only rated an audience with the lower levels of the company, which overall does have a pretty solid reputation on Sand Hill Road, but still it was almost insulting.

Let’s just say my bullshit meter was halfway to pegged before I started the first sentence.

However, I found most of the article to be spot on. In my “Is Open Source Dead?” post I talked about how open source is both greatly increasing while the classic ideals of open source (i.e. free software for everyone) seem to be going away.

My own philosophy is that, at least for certain large and complex (i.e. expensive) software, the proprietary software model is doomed. Customer needs are changing so fast that no closed system can really keep up, and we’ve seen that in the biggest OpenNMS customers. I spent the last week in Ireland and the client was complaining that before they started using OpenNMS, whenever they needed some new functionality in their management solution the proprietary vendor took too long, cost too much and delivered too little to be worth it. Using a free platform like OpenNMS made it much easier to adapt the tool to their business workflow, instead of having to change it to meet the workflow of the management software. There is value in that – value that can be monetized.

Peter Levine started to win me over with “Red Hat is a fantastic company” (grin) and I as I read on I found my head nodding in agreement. He states

Unless a company employs a majority of the inventors of a particular open source project, there is a high likelihood that the project never gains traction or another company decides to create a fork of the technology.

While I estimate OpenNMS has around 40 to 50 active contributors, at least 15 of those are on my payroll, either directly or indirectly as contractors. While I definitely would like to increase the overall number, we are growing fast enough that we can usually hire someone who contributes a lot to the project, and then, since they can spend their full time on it, we as a group continue to contribute greater and greater amounts of the overall code. When I started out on my own back in 2002, I think at least half of the code came from outside of the .com side of things. Now it is probably closer to 5% or less. It has managed to let us focus on our direction for the application.

Then Levine continues:

To make matters worse, the more successful an open source project, the more large companies want to co-opt the code base. I experienced this first-hand as CEO at XenSource, where every major software and hardware company leveraged our code base with nearly zero revenue coming back to us. We had made the product so easy to use and so important, that we had out-engineered ourselves. Great for the open source community, not so great for us.

I’ve heard this tale from a number of people. Become successful and someone like IBM could dump 100 developers on your project and take it over. While we haven’t experienced it directly (rarely do people tell me OpenNMS is “easy to use”), we are constantly finding out about companies who have either based products on OpenNMS or used OpenNMS to provide services for profit. I think this is great, but it would be nice to capture some of that effort back into the project, either in the form of contributions or cash. It is one reason that the next major release of OpenNMS will be published under the Affero GPL.

So, with all this doom and gloom, what is the solution? Levine’s answer is “sell open source as a service”. I couldn’t agree more. This is exactly what we pitched to A16N. It’s something of a “win/win”.

This recipe – combining open source with a service or appliance model – is producing staggering results across the software landscape. Cloud and SaaS adoption is accelerating at an order of magnitude faster than on-premise deployments, and open source has been the enabler of this transformation.

If you have the in house development staff to leverage open source, it makes sense to become active in the community. David just finished a five stop roadshow in both the US and Europe describing the OpenNMS roadmap over the next year as we position the product for the Internet of Things. He met with our largest customers and all of them are eager to get involved, many pledging, OpenDaylight style, to provide the project with developers. They get input into the direction of the product and we get great open source code.

But what if you aren’t a large medical information company or a worldwide financial institution? You may need what OpenNMS can provide but don’t have the time to build in the workflow or customize it. We will have a solution for you.

The only issue I ended up having with the article was when he compared Red Hat to Microsoft, Oracle, Amazon, etc. Sure there might not be another Red Hat, but I don’t expect to see another Microsoft (operating systems and office suites), Oracle (enterprise software), or Amazon (online product distribution) either. This doesn’t mean that there won’t be new mega-companies. In ten years I expect there will be some huge companies that no one today knows about, probably in the areas of 3D printing and biotech (specifically integrating tech into the human body). Enterprise software companies will be represented by a number of large-ish but nimble companies leveraging open source, and I wouldn’t count out Red Hat just yet as they too are pivoting to follow this new business model.

I want to close with one little story. I spent last week in Ireland where I just happened to be in Dublin where the band Wheatus was touring with my friend Damian (MC Frontalot) opening. They had a grueling schedule (shows almost every night) but I managed to see their concert and talk with them afterward.

Damian has just released a new album (it’s excellent, buy it) and he closed his set with “Charity Case” which includes the lyric:

It’s true:
Frontalot’s destitute.
I need you
to buy my CD so I can buy food.

He often pokes fun on the changing nature of the music business (his song “Captains of Industry” suggests that he is not a musician but instead is in the T-shirt business), and we talked about various business models. I pointed out that acts like Elton John are living the high life from work that basically peaked in the 1970s, and that sort of “royalties for life” model is gone. In its place are artists who sell directly to their fans, often including personalized premiums for a higher price, and touring. The band Phish tours extensively and they make millions, all the while encouraging their fans to bootleg their music, something old school musicians wouldn’t think to do.

At this point Brendan, the founder and front man of Wheatus, joined us and stated “there is nothing an old musician can teach a young one about the music business”. That quote really resonated with me.

In summary, I really enjoyed this article. It mirrored a lot of our thoughts over the last year as we seek to make OpenNMS successful. Remember, our plan is for OpenNMS to be *the* de facto management solution of choice and for that to happen will take a lot of work as well as money. But one thing that we will continue to do to emulate Red Hat is to keep publishing as much software as possible under an OSI-approved open source license.

That is still a key to our success: OpenNMS will always be free and OpenNMS will never suck.