IBM developerWorks Interview on Open Source Business Intelligence

A few weeks ago, I had the very enjoyable experience of chatting with my friend, Andy Glover, on the phone for a little while. We talked about open source business intelligence, including a few popular tools and a few key concepts that are well known to database professionals but not so well known to developers. Or as Andy put it, “Tools techniques, and sardonic wit.” That’s me! Give it a listen today:

http://www.ibm.com/developerworks/java/library/j-gloverpodcast/

Leave a Comment

Gaelyk at the New York City Java SIG

I had the immense pleasure of traveling to New York City last week to speak at the NYC Java SIG to promote the upcoming No Fluff Just Stuff show in Jersey City. The Java SIG is what most people call a JUG, but in world class cities, they have a bit more flexibility in setting their own conventions. You’re going to call it a SIG, and you know what? You’re still going to love it.

The building where the NYC Java SIG meets

I’ve driven through and around Manhattan before, but I’ve never really been in the city. I had a scant 20 hours to enjoy the place, which I did with some abandon. I’m fundamentally a man of the suburbs, but I love the city, and lovers of the city are truly bound to enjoy Midtown. I will certainly be back at my earliest opportunity.

The JUG—or rather, the SIG—is led by the redoubtable Frank Greco, CEO of Crossroads Technologies (no relation). I gave my talk on Gaelyk, shown here:

There was lively discussion about Gaelyk’s very lightweight structure as a framework, and the limitations imposed by that structure. Many of the SIG attendees are Enterprise developers in the classical sense, so a product like this was understandably strange to them. And to be sure, I would never commend it for use in anything of even moderate complexity. However, for sites so simple you don’t want to incur the cognitive cost of dealing with a larger framework, and for which any kind of sophisticated hosting would be overkill, Gaelyk is a perfect fit. Interaction with the audience moved delightfully to a discussion of the way our tools shape the way we solve problems, and even the kinds of problems we consider tractable. Winston Churchill was quoted. Neal Postman was referenced. Nick Carr’s latest book was commended. Win, win, and win.

All in all, an enjoyable trip and a solid talk with a first-class JUG. Thanks to Jay Zimmerman and the NYC Java SIG for the experience.

Leave a Comment

Scandinavian Developers Conference 2010

Scandinavian Developer Conference 2010Last week I had the pleasure of speaking at the Scandinavian Developers Conference in Goteborg, Sweden. I flew out on Sunday afternoon with my friends Matthew McCullough and Paul Rayner, who were also speakers at the conference. We arrived in Göteborg on Monday afternoon and checked into the Hotel Gothia Towers, finding comfortable rooms with all of the free, fast broadband a geek could want. This is the stuff of Norse epics.

The conference’s organizers treated the speakers to an exclusive dinner on Monday night at a nearby restaurant whose name was sadly lost to jet lag. Conversation flowed freely for hours among world-class talents whose company I was honored to keep.

The show opened on Tuesday with a keynote by Michael Feathers. Michael observed that the software community has thought less about design and more about process in the past decade. He suggested that web-scale computing heralds a return to constraint-based engineering, which will cause some strain in previous approaches to design and will likely overthrow the recent emphasis on process, restoring engineering to a prominent place in the work of the software developer.

Conversation CornerOn Tuesday, Matthew and I led a fishbowl discussion on “the dire need for encryption in web apps.” Technology topics often provoke emotional disagreements and highly affective conflict, but encryption is rare in that it also to touches concepts and passions that are as much social and political as technical. We spoke very little of key lengths and rainbow tables and much more of the economics of encryption, the nature of private property, and the relationship between the State and the individual. Our community needs more panels like this one.

Lone Attendee With ScheduleThe show’s seven tracks covered many topics, but overall evinced a heavy emphasis on Agile and Lean methods. Diana Larsen’s keynote on Wednesday morning riffed on the role of the manager is the agile organization, describing leaders more as curators of human flourishing than directors of mechanical activity. The more I interact with agile thinkers, the more I’m persuaded that this is a philosophical program I can get behind.

I spoke Wednesday afternoon in the Emerging Technologies and Cloud Computing track on how to use Grails and JMX together. My talk gave a lightning overview of Grails for the uninitiated (which turned out to be nearly everyone in attendance), a quick refresher on JMX, a video tutorial on how to manage Tomcat from VisualVM securely and over a public connection, a description of the Grails plugin architecture, and a quick tour of the kinds of the things the Grails JMX Plugin will let you do. It ended with a live demo of controller action statistics exposed by the plugin as MBeans. We even ended five minutes early!

Goteborg BuildingI ended the conference with Kent Beck’s talk on Wednesday afternoon about the organizational changes necessary to release often. He discussed the kinds of organizational structures implied by a discipline annual, quarterly, monthly, weekly, daily, and continuous releases—fascinating process thinking from a true thought leader. I had the unexpected pleasure of sitting with Ken, his partner Cindee, and two of their daughters at Dinner 22 after the show. Our discussion of value-based consulting and integrating family life into a heavy travel schedule was more helpful to me than two hours of TDD mentoring would have been—and it’s not like I couldn’t use expert help with the latter.

Which is to say nothing of the reindeer steak, which may end up being the best food I eat this year. Time will tell.

SDC 2010 Exhibition HallMatthew, Paul, and I spent Thursday exploring Göteborg. Despite the cloudy and cold day, we found that the city had much charm to offer. It is safe, clean, and offered plentiful cafes filled with earnest, multilingual conversation, coffee, and all the baked goods you could metabolize. (Wifi was less than plentiful, but we managed to survive.)

The conference itself was superbly organized and run—and I don’t say that only because they had the foresight to accept a talk on Grails. The organizers took good care of their speakers, selected world-class headliners, incorporated sponsors in an appropriate way, and encouraged some nontraditional forms like the fishbowl talks and the open-space-style “conversation corners.” A huge thanks to Lennart Olsen of Iptor Konsult AB for his outstanding work, and especially for his coaching of my Swedish—which, as he pointed out, is not nearly as good as my surname might suggest!

It was truly a world-class conference which I’d be happy to attend again next year. Thanks to all who made it possible.

Leave a Comment

My Spring Speaking Schedule

Here’s a partial list of my speaking engagements over the next few months. Another event or two may pop up, but this is it for now. If you’re near one of these, I’d love to meet you!

Leave a Comment

Announcing a Partnership with ThirstyHead

I’m very pleased to announce my partnership with ThirstyHead.com. ThirstyHead is a training and consulting company that specializes in Groovy and Grails solutions. I’m still going to continue every bit of my work at the August Group as a writer, speaker, and software developer, but I’ll be joining forces with Scott and Andy for classroom training. ThirstyHead is a strong brand in the Groovy and Grails training space, and I couldn’t be more pleased to be a part of their team. Look for continued G2 Goodness from ThirstyHead, as well as new offerings in the near future. Stay tuned for more!

Leave a Comment

The Rumors of IE6′s Death Are Greatly Appreciated

Like a terminally ill dictator in exile, IE 6 has been hanging on for far too long, forcing legions of web developers to to relive the pain of its tyranny every day. An IE Icon in Ruins Happily, it’s starting to look like the old bugger might finally pass away.

It’s no longer news that Google is phasing out support for the browser, and more anecdotally, a very tech-savvy client of mine has eliminated support for it in its next-generation web app—an app which is responsible for the entire business and is exposed to external customers as well as internal users. When smaller technology companies who lack the power to move the market are making decisions like this, it means the end is near.

A Denver area design consultancy has now gone so far as to schedule a wake for the dying browser. What a fun way to celebrate a laudable technology development and generate some positive buzz at the same time! My hat is off to you, Aten Group.

Everybody who makes software makes bad software sometimes, so I’m always hesitant to blast bad code when I see it. That said, IE 6 was for years a gratuitous drain on the flourishing of the web and the cause of more misallocated capital than a hundred failed dotcoms. It will be a relief to see it go. May the future of the web be more competitive and less autocratic.

Broken IE icon courtesy of Zakar.

Leave a Comment

Reducing Headphone Noise from the HyperMac Battery

I first bought my 100WH HyperMac battery on the recommendation of Scott Davis. It’s a great way to survive a long flight with a layover or spend some time in a cafe without worrying about being near a plug. Scott had warned me about the hiss it caused in the headphones (which didn’t stop me from temporarily convincing myself my headphones, then my MacBook audio output, were broken, before I remembered his advice), so I theoretically knew what I was getting into.

The hiss is actually pretty bad. On my machine, it quickly got to the point where I couldn’t enjoy listening to music while using the battery. Since the my two primary use cases both recommend headphone usage, this was a major bummer.

I have a theory of what caused the hiss. I haven’t been able to test this with my spectrum analzyer yet—yet!—but I think the problem has to do with the power converter in the HyperMac. The unit isn’t just a dumb lithium ion batter and a charger; it’s actually got a DC/DC converter onboard, presumably because the specified voltage on the MagSafe connector was not easy to achieve with lithium ion cells. And switching power converters mean noise.

I’ll skip some tedious details, but you can read more about switching power supplies on your own if you’d like. Basically, despite the best efforts of the power supply designer, a switcher will couple noise into its output at the switching frequency of the converter (plus its harmonics). Linear power supplies, distant cousins to switchers, avoid this, but at the expense of size, weight, and efficiency. This is why your stereo receiver is big, heavy, and hot—but sounds great.

So the HyperMac battery contains a switching power converter, and this switcher is busily coupling its noise into your MacBook when you’re plugged into it. My theory is that some of that noise is getting coupled through the power input and into the audio output circuitry, causing the hiss. Pretty straightforward, and suggestive of a simple fix.

But wait! Before I “fix” this problem, you’re dying to point out a flaw in my argument: Apple’s plug-in power adaptor (what power supply designers call an “off-line” supply, because it draws power off the line voltage) is a switcher too! Why doesn’t it hiss? Well, this is what I’d have to take some measurements to confirm, but I’m guessing the switching frequency of the Apple product is matched to noise rejection circuits in the power input or our audio output circuitry of a MacBook. The switcher in the HyperMac battery either switches at a different frequency that bypasses the MacBook’s filtering, or its noise is just louder. I could be wrong about this, and I don’t mean to cast aspersions on a great product. However, the headphone hiss is certainly real, and this is a decent hypothesis, easily strengthened with some simple measurements.

Which I hope to do soon. In the mean time, it’s easy to knock this noise down below audible levels. Enter the HyperMac user’s best friend, the ferrite toroid:

Ferrite toroids are a beloved hack of noise-hating hardware designers everywhere. They don’t deal with the noise problem at its source, but they do stop it from spreading. With a 19mm internal diameter toroid from DigiKey, I was able to wrap the HyperMac’s power cord through it several times.

With this in place, I am no longer able to hear a hiss in the headphones. Your mileage may vary, but this hack has no choice at least to help a little bit, plus it looks kind of cool. With this hack in place, you have no excuse not to have a HyperMac battery. Let me know how it works for you!

UPDATE: a reader asked offline if the toroid was a concern near non-solid-state hard disks. The answer is no, since it’s not a permanent magnet by itself. It’s a ferromagnetic material with high magnetic permeability, but on its own can’t harm your hard disk or any of those 8½” floppies you’ve got lying around.

Comments (6)

Ohm’s Law and Grails Form Submissions

Back when I wrote firmware for a living, every project had an exciting phase in the middle which we called “bringing up the board.” Bringing up the board consisted of getting a fresh, chemical-smelling new circuit board from a short-run manufacturer, applying power to it, and attempting to take control of it with software. It sat neatly in between a very waterfall-ish design and coding phase at the beginning and a very deathmarch-y integration and test phase at the end.

Bringing up a board requires intensive, cross-disciplinary debugging in which very few abstractions are of any use to the engineer. Rarely do enterprise software developers think about things like reset vectors and fetch-and-execute cycles (much less voltages and currents), but these are the stock in trade of the firmware developer working with a brand new hardware design. The phase is full of the seemingly intractable problems and contradictions that normally attend test-last debugging. Inevitably, at least once on each project, some impossible condition will arise in which the engineer knows he is flipping a bit in a control register somewhere, and he knows the corresponding digital output pin is driving a high impedance, but somehow under such-and-such conditions the trace on the oscilloscope barely wiggles when it should be banging back and forth between five volts and zero. He’s sure of everything else in the system, he knows he’s got the address of the control register right, he’s certain he understands the circuit the output is driving. There’s just no other option: Ohm’s Law must be wrong in this case.

Of course it never is. And while widely used, production-ready web frameworks like Grails are less reliable than fundamental laws of physics, they can probably handle trivial form submissions with aplomb. Of course, that still didn’t stop me from thinking Grails had a bug last week.

I had generated some scaffolding for a fairly simple domain class, and had begun elaborating on it in the way that any Grails developer does for a real-life application. The GSP code looked something like this:

<g:form controller="assessment" action="save">
  <g:each var="q" in="${questions}">
    <p><g:render template="question" model="[question:q]"/></p>
  </g:each>
  <div class="buttons">
    <span class="button"><g:actionSubmit class="submit" value="Submit"/></span>
  </div>
</g:form>

When I clicked on the submit button, I got a 404 error. I verified that AssessmentController had a save action, which it did. I bounced Grails, which I was running in dev mode. Still no love. I banged my head against this for a while, unable to believe that I couldn’t get a form submission to work. Was it some strangle UrlMapping oddity? Was it a problem with allowed HTTP methods? Nothing made sense.

So I decided to bypass the Grails GSP tags and code up a form myself. It looked like this:

<form action="/app/assessment/save" method="post">
  Question 1: <input type="text" name="question-1"/>
  Question 2: <input type="text" name="question-2"/>
  Question 3: <input type="text" name="question-3"/>
  Question 4: <input type="text" name="question-4"/>
  <input type="submit" name="Submit" />
</form>

That worked perfectly! My next task was to figure out what was different between the two requests. Ever a fan of the big hammer (my favorite debugging tool in my firmware days was the oscilloscope), I broke out HttpFox to see what was happening on the wire.

I saw, as you might expect, two apparently identical requests that looked something like this:

HttpFox Capture of Two Grails Requests

No differences in headers, request URL, or anything that might affect how the request would be routed to an action. Everything was the same until I looked at the POST Data tab. The version of the form that was built by the Grails tags looked like this:

HttpFox Grails Forms Values

while my custom form generated these parameters:

HttpFox Custom Form Values

The _action_Submit vs submit difference should have tipped me off right away, but it didn’t. I had simply forgotten that Grails is capable of doing request mapping through the submit button, so I continued plugging away at the code for longer than I’d care to admit. I knew at this point that there was some kind of internal processing of this form parameter going on, and was ready to resign myself to spelunking in the source to figure out what it was. Since this was such a basic operation going on here, surely this had to be a bug in the framework excited by an as-yet-undetected subtlety in my form markup. Surely. Then it hit me: the form code I was debugging used <g:actionSubmit>. Shouldn’t that be <g:submitButton>?

Sure it should, if g:submitButton is all you ever use. I’ve never been a big fan of scaffolding—a conceit I have long suspected is to my detriment, and one I am currently in the process of reforming—and I had never had occasion to become familiar with g:actionSubmit. What that magical tag does is allow you to include multiple submit buttons inside a single form, each of which targets its own action within a given controller. Great idea, and great tag. And an epic failure if you’re trying to accomplish mapping through the tag and ignore the submit button tag’s parameters altogether.

I’m tempted to conclude that the moral to the story is to know how your web framework accomplishes simple tasks like form submissions, even if it throws a few nice features your way to spice them up a bit. And there is nothing wrong with knowing this; in fact, it’s a good trick if you can do it.

The real lesson, however, is about debugging. Ohm’s Law is never, ever, ever wrong, and when you sit down with ohmmeter and oscilloscope and proceed to prove that it is, all you’re doing is establishing that your mental model of the problem is badly off-base. Grails, like any web framework or well-used public API, sometimes is wrong—it is not a fundamental physical law—but public releases probably aren’t wrong about trivial things like form submissions. If you think you’ve got a bug so obvious that someone had to have caught it in the past, then somebody probably did. The bug is probably with you, either trivially in your code or even in your debugging process itself. In the heat of the chase, it can be difficult to remember this, but how often is the resolution to the story actually some complex subtlety that takes hours to explain? Sometimes it is, but most of the time you’re just using the wrong tag. Looking for the obvious is probably going to pay off well in advance of a deep dive into the code. Or, for that matter, a reconsideration of classical physics.

Comments (3)

VMWare Fusion Bridged Networking Error

I’m building some simple .NET web services in a VMWare Fusion VM running Windows XP. I’d like to consume those web services from Grails code I’m developing on the host OS, which is a Mac. The easiest way to hit IIS in the VM is to switch the network connection to bridged mode, as shown here:

VMWare Fusion Network Configuration

I had been doing this happily for a week or so, when suddenly yesterday afternoon it quit working. I tried to put a new VM into bridged mode, and I got this unhappy dialog box:

VMWare Bridged Networking Error Dialog

The guest OS (Windows XP) was insisting that the network cable was unplugged on my virtual LAN adaptor, and I had no way to hit my .NET services from the glorious host OS. Googling around a bit suggested that this was a problem when the Mac had more than one network adaptor configured, but that made no sense: I always have two network adaptors (wireless and wired), and have done bridging successfully while using one or the other, and sometimes while both are recognized by the OS as live options for network traffic.

Skipping to the end for your convenience, it turns out the problem was with the VPN. I can use bridged networking as much as I like, just as long as the Mac is not connected to the VPN. Even if I try to establish bridged mode while disconnected from the VPN, then connect to the VPN afterwards, it still disabled by bridged network adaptor in the guest OS. Host VPN and bridged guest simply will not coexist.

Which is great and all, but the .NET services I’m running in XP need to connect to a database server available on the client’s private network, so without a VPN, I’m sunk. The happy ending is that I can establish a VPN connection in the guest OS—in Windows—while the Mac is happily VPN-free. This still disables some of the tooling I rely on for efficient development, but it’s as good as it’s going to get, and ultimately, it’s workable.

Comments (1)

Amazon Kindle: First Impressions

Two weeks ago I finally succumbed to the temptation to order a Kindle. Availing myself of my Amazon Prime subscription—a service which may now find itself obsolescent—I had the device in my hands last Wednesday. My goal wasn’t just to have a new and more convenient way to read, but to figure out whether the Kindle actually delivers on that promise.

It came out of its elegant, Apple-like packaging with an image on its screen—not something you expect from a powered-off device. Having seen a Sony ebook reader before, I expected the Kindle’s screen to look fake, and it did. It was as if someone had cut out a piece of printed paper and glued it on the front of the unit. Its somewhat odd power switch worked fine, and it turned on after a few seconds. It was easy to connect it with my Amazon account (I don’t even remember the process, in fact) and wirelessly browse the Amazon store through the 3G “Whisperlink” connection. My first book purchase, which I made from the web site on my laptop, appeared on the Kindle quickly.

My first impulse, and the first impulse of several other new users who got their hands on it, was to tap the screen. I expected to swipe to turn pages, and I presumptuously expected a multi-touch gesture to bring up a coverflow-like view of the pages through which I could scroll by swiping. Somehow I doubt my reaction is unique, at least among iPhone users. At first blush, it seems imperative that future generation devices support a touchscreen.

Actual reading is quite pleasant. Text is almost suspiciously crisp and passive-looking, just like a printed page. The digital paper display is famously slow to update, reminding me of laptop screens from twenty years ago. This makes interactive functions like scrolling through menus, navigating tables of contents, or shopping in the store somewhat frustrating (and it would render my expected touchscreen functionality all but useless), but is easy to overcome in actual reading. I soon learned to anticipate the page refresh delay by pressing the next page button while my eyes were somewhere near the beginning of the last line of text on each page.

Later, I pushed a few of my book purchases to the Kindle app on my iPhone. There is an immediately obvious difference in the feel of reading on the iPhone and on the Kindle. On the iPhone, the expected touch gestures work. There’s still still no multi-touch coverflow interface, but there is a draggable slider that quickly scrolls to any location in the book. The book seems more interactive, and has a massless quality to it. Compared to the Kindle, the iPhone screen itself looks alive. You can quickly be anywhere in a text almost as easily as flipping the pages of a bound paper book. The same text on a Kindle has some random access capability through the table of contents and the search function, but otherwise the slow speed of the display rewards sequential, page-after-page reading.

In other words, reading the Kindle is more like a reading scroll than a bound book—a scroll with a search box.

So my first reaction is positive, and I’m going to continue favoring it for the delivery of new books when possible. I’d like to use it for several different kinds of material (i.e., fiction, technology, theology, article-sized works, etc.) to get a sense for how the different reading habits associated with different texts work on the device. My larger question, which can only be answered over the course of months, is how the new form will alter my reading habits and my perception of the texts themselves. Even if, pace McLuhan, the medium isn’t identical the message in a strict sense, the message is clearly shaped and constrained by the medium in important ways. It seems clear that ebook readers will be a big part of the future of text, so understanding the new form might be a good plan.

Leave a Comment