Ohio-area PowerPivot summit?

November 5, 2009

“There’s enough of us here to start a crime wave.”

-Vincent “Vinnie” Antonelli

Just spent 90 minutes on the phone with Dick Moffat, of http://dmoffat.wordpress.com/ and formerly a big part of OfficeZealot.  Longtime Excel and Access developer and consultant, we met before several times in Redmond but this was our longest chat to date.

And, of course, he is super excited about PowerPivot.  Like me, he thinks it’s not only a big deal for the BI universe, but also a tremendous infusion of new excitement and potential for the Excel pro and Office Developer communities.

So, here I am in my new digs in Ohio (moved here in August after 13 years in Redmond) and suddenly discovering that it’s a hotbed of PowerPivot interest!  Mr. Excel is in Akron.  Dick Moffat is just across the lake in Canada.  MizzDataViz, the official best friend of PowerPivotPro and recent ex-Microsoftie, is um, much closer than that.

There are more of you out there, I am sure.  In fact I’ve heard from a couple of you already.

If I organized some sort of lightweight get-together in Ohio for PowerPivot professionals, how much interest would there be?  Send me an email, post a comment, etc.


Trusting the data…

November 4, 2009

…sometimes is easier in the business world than elsewhere.  I loved this short article:

http://sethgodin.typepad.com/seths_blog/2009/11/when-data-and-decisions-collide.html 

Couple excerpts:

The data shows, for example, that texting while driving is more dangerous than driving drunk. It doesn’t feel that way, of course, but will you respect the data and stop, cold turkey?

The data shows that the vast majority of wine drinkers can’t tell the difference between a $20 bottle and a $100 bottle. Will that keep you from buying the fancy wine? How much is the placebo effect worth?


Hiding fields from the field list in CTP3

November 4, 2009

Colin posted a good comment regarding my last football post:  not all columns/tables from the PowerPivot window are needed in the Field List, and it would be better if we could hide them.

Turns out that there IS such a dialog in CTP3 (I’m told it was also in CTP2, I just never used it):

   PowerPivot Hide Fields Dialog

This is showing me all fields from the DimLeadingVsTrailing table, and lets me hide fields – both from the PowerPivot window, and from the Pivot Field List.

OK, so I marked 3 of those 4 fields to be hidden from the Field List.  I also marked ALL of the fields from the DimHomeAway table, and here is what the Field List shows me now for those tables:

   PowerPivot Hidden Fields in Field List

OK, I only see Description from the one table, as expected.  Nice :)   And the DimHomeAway table is no longer expandable, because all of its fields are hidden.

One could argue, of course, that maybe DimHomeAway should not show up at all.  In fact, I’m gonna go make that argument right now :)

(Update:  we are trying to fix that before we release final bits.  Cross your fingers.)

Next Football Post


Relationships, Pivots, and DAX: The Payoff, Part One

November 3, 2009

Recall that in yesterday’s post I linked my FactEvent table to the CleanPlayers table via a relationship.  Time for the payoff.

But you know what?  I’m tired of calling it the FactEvent table, and then constantly having to tell everyone that’s where the plays are stored.  It’s the Plays table, damnit, so I’m just gonna right-click and rename it before moving on:

              PowerPivot Rename Table   Becomes…  PowerPivot Rename Table 2

Which does NOT impact the relationship I made.

Just in case you doubt the value of Beta releases…

I’ve actually hit a bug here where the relationship I created yesterday prevents me from saving and re-opening the file.  I’ve filed the bug and expect it has something to do with either the data cleaning I did or the fact that CleanPlayers is a linked table, because I have not seen this before.  As Dennis Miller used to say, “Well at least you know it’s live…”

Time for Multi-Table Pivots!

Showing this feature is going to take discipline, because there are a number of fun things along the way to distract me (ooh!  shiny!).  I’ll try to note things in passing and promise to return to them later.

I want a PivotTable that shows me some aggregate data.  So I go to the ribbon in the PowerPivot ribbon, click on the old reliable PivotTable gallery button, and…

PowerPivot Offers Some Shiny New Pivot Options!

…we see a bunch of intriguing options there!  But even though I designed that feature and love it like a child, I’m just gonna stick to the basics and go with a Single PivotTable :P   (I promise, we’ll come back later!)

I choose to place this PivotTable in a new sheet, and now I see this:

PowerPivot Blank Pivot

Couple things to note:

  1. The PivotTable is on a normal Excel sheet – that’s important.  The PowerPivot addin does not render a single pixel of report or visualization.  That is ALL Excel, which is good, because we want everything to render to the browser via Excel Services later.
  2. This is not your father’s field list – there are definitely some new things happening over there on the right side…
    Let’s take a closer look at the top of the field list first:
                   PowerPivot Field List Top

    Every Table from the PowerPivot Window Appears Here

    Yes, all 40+ of them.  I’ve expanded a couple of the smaller ones so you can see their columns.

    This is a big departure from normal Excel PivotTables, and their “one table at a time” restriction – if that seems limiting to the BI Pros out there, well, it is.  See what your Excel friends have labored with all these years?

    Search Box

    And since that means a whole lot more fields than your average Excel field list, we’ve got a Search control at the top (great work team, getting that in!)

    The bottom of the field list also contains some new goodies:

                 PowerPivot Field List Bottom

    The bottom four dropzones should be familiar, but the top two – Slicers – are new.  I can’t resist, so I’ll give a quick preview of those in a second.  For now, though, I want to build a quick, simple report.

    First, I check the Yards field under the Plays table:

    Clicked the Yards Checkbox  which yields:

                                                                PowerPivot 1-Cell Report in the Excel grid.

    BI Pro sez:  “OK, What Happened There?”

    If you’re a BI Pro and you’ve been taking notes, you know that under the hood, PowerPivot is SQL Server Analysis Services, and SSAS doesn’t just fork over numbers.  It needs “measures” defined first.

    Well, the addin defined one on the fly.  The user checked a checkbox, the addin sees that the field in question (Yards) is numeric, then tells the PowerPivot engine that it wants a Sum of Yards measure defined.  Once that is complete, the addin then tells the Excel OM to add that measure to the current PivotTable.

    So… the Excel user gets the experience they are accustomed to (numeric fields default to Sum’s, in the data area of the pivot), and BI Pros can understand that a real OLAP measure has been created behind the scenes.

    Moving on, I then scroll the field list down to the CleanPlayers table and check the FullName checkbox (recall that I added this field yesterday using DAX):

    Clicked the FullName Checkbox  which yields:

                                         PowerPivot Yards by Player in the Excel grid.

     

    (Translation for BI Pros – in this case, FullName was just an attribute – all columns in the PowerPivot window are attributes actually.  And since the addin detected it was non-numeric, we just slapped it on rows without creating a measure.  Which again mimics Excel behavior).

    (Note for football geeks:  Aaron Gibson, –272 yards lifetime?  And look at Aaron Rodgers, still riding the bench behind Favre back in 2006, the last year for which I have data.  BTW, don’t trust any of these numbers yet – I think I have a lot of work left to do).

    What say you, Excel Pros?

    You impressed yet?  One little 4-box relationship dialog from the last post, and suddenly you are pivoting one table by the fields in another?

    Still letting it sink in, eh?  OK, let’s drive it home.  Every field in the CleanPlayers table is now a valid field for grouping/filtering/slicing the Plays table…

    The Grand Finale (for today)

    Remember those two mysterious extra dropzones for Slicers?

     

              PowerPivot Slicers Dropzones

    Now I’m going to grab the BirthStateName field from the CleanPlayers table, drag it into the Slicers Vertical zone, and I get this…

    PowerPivot Slice By BirthState

    Yeah, that’s called a Slicer.  A new feature of Excel 2010.  Works a lot like a Page Filter (aka Report Filter), but more graphical and “Fisher Price,” to quote a former colleague.

    Wanna see just players born in sunny states like FL, AZ, HI, and CA?  Single click to select one, ctrl-click to select multiple:

    PowerPivot Sunny States

    And then my personal favorite, single-clicking England:

       English Football Player

    I give you Osi Umenyiora, the only, ahem,  English Football Player in the NFL.

    One little relationship suddenly tells us quite a bit doesn’t it?

    (It even gives us cheesy jokes that equivocate on the term “English Football.”  Such power.)

    Next Football Post:  My First Video Post >>


    Playing with theme again…

    November 3, 2009

    Giving the site a custom facelift, apologies if it temporarily appears wacky.

    (Mostly done, but I do miss the readability of the prior theme.  Going to get my live-in web designer to slowly restore elements of that readability :P )

    Thanks Jocelyn!


    LinkedIn Poll on Excel BI Usage

    November 3, 2009

    I wonder how this will change after PowerPivot is released…

    LinkedIn Survey on Excel BI

    Click here for the full, interactive version.

    I found it intersting that Large and Medium orgs use Excel as a frontline, recognized BI tool more than Enterprise and Small.  Anyone have thoughts on why?


    PowerPivot Football Project: The first DAX formulas, and Relationships

    November 2, 2009

    Continuing the series on The Great Football Project…

    When we last left off, recall that I had used Excel-linked tables to clean all of the “no name” players out of the DimPlayers table, creating a CleanPlayers table to take its place.

    Clean Players Table

    I pretty quickly realize that I still have two problems:

    1. Hey, not all of my remaining players have BirthName’s! (First Names)
    2. I don’t have a FullName column, which is gonna be awkward when I build reports

    Turns out that I can solve both problems with a single calculated column.  Time for some…

    DAX Formula Language

    DAX is the formula language of PowerPivot.  DAX really could have been named “Excel Formulas++” but we went with the catchier name.  Because really, DAX is just Excel’s formula language with a number of nifty improvements.

    I use Ctrl-RightArrow to jump over to the rightmost edge of the table, since PowerPivot supports commonly-used Excel keyboard shortcuts, to the Add Column:

    Adding a Column

    And then I start to type the following formula:

         =IF([

    and see:

    PowerPivot Formula Bar

    Let’s stop there briefly, because there are a few things worth noting already:

    1. I’m starting my formula with the typical “=” Excel syntax
    2. It uses the IF function, and you can see from the function signature under the formula bar that it’s the same IF function from Excel
    3. All column names in PowerPivot are wrapped in square brackets
    4. Once I enter the open square bracket, I get AutoComplete against all columns in the current table! 

      OK, let’s just finish the formula.  I notice from the dropdown that there is a [NickName] column, and I remember that in this db, most of the time you want to use [NickName] over [BirthName].  So I’ll fall back to using [BirthName] only when there is no [NickName]:

           =IF([NickName]="",[BirthName]&" "&[LastName],[NickName]&" "&[LastName])

      (I used the & operator instead of =CONCATENATE for readability reasons.)

      I rename the resulting column to be FullName and I’m done.  I’ve added an expression-based column to a state of the art, in-memory, column-oriented store (the PowerPivot db), but I don’t really think about it because there was no SQL syntax, no MDX, no VB expressions.  I just added a calc column using Excel syntax.

      FullName Column 

      Relating this to the FactEvent table

      The FactEvent table, that contains the plays themselves, does not contain player names – it contains player ID’s.  This is good db design, but it’s typically a pain for Excel users, since Excel’s features pretty much only work on single tables.

      Excel users denormalize multiple tables into one by using functions like =VLOOKUP() that get the job done, but are tedious to write, are often slow to execute on large datasets, and result in large spreadsheets.  Plus they have to write one such formula for every column they want to grab from another table.

      PowerPivot really shines here, and I suspect Excel pros will adopt it for some of their work based simply on this one capability:  PowerPivot is a version of Excel that supports relationships between tables.

      Conceptually Similar to VLOOKUP

      If I want to think about relationships in a similar way as VLOOKUP’s, I can.  I go to the “big” table – the one with the most rows, the one I want to augment with data from other tables.  In this case, FactEvent.  On the Table ribbon tab there’s a Create Relationship button:

      PowerPivot Add Relationship

      This brings up the following dialog:

      PowerPivot Relationship Dialog

      I’ve filled in the right values in each dropdown, and done so thinking as if I was writing a VLOOKUP (well, ok, a VLOOKUP where I can match on any column, not just the first column of the lookup table!)

      …and if I happened to get the two tables reversed in my head, no worries, PowerPivot figures that out for me.
          And for my next trick…
          Pretty cool and all, but the real fun starts after I have the relationship is in place.  Fireworks
          in tomorrow’s post. 
             
            Next Football Post:  The Payoff of Relationships and Formulas >>

          SharePoint Samurai’s Surrational SharePoint Fairy

          November 2, 2009

          Truth is indeed stranger than fiction.  I am not making this up – 1) There IS a SharePoint Samurai, and he is quite famous in the SharePoint community.  and 2) He DID do some artistic SharePoint Fairy interpretations in PhotoShop:

          SharePoint Fairy by Samurai v1   SharePoint Fairy by Samurai v2

          (CORRECTION:  These imges were taken/rendered by Marcy Kellar, not the Samurai.  Apologies to Marcy.  See more of her work from the SharePoint conference here:  http://marcykellarstudio.com/events/spc09 )

          The SharePoint Samurai’s name is Michael Gannotti, and he does actually wear his Samurai outfit to conventions.  I had not heard of him until recently, but he is quite the presence in the SharePoint scene:

          The SharePoint Samurai, Michael Gannotti

          (Click image to visit his impressive site, complete with SharePoint Fairy interview!)

          BI and Excel Pros – do we have anything like the Samurai and the Fairy?  I think not.  The gauntlet has been thrown down by the SharePoint community. 

          Who among us will take up this challenge?


          Haunted by myself, circa 1996

          November 2, 2009

          In order to more efficiently work on the Great Football Project, I installed Office 2010 Beta 2 at home and am now running the new Outlook.

          …and the new Outlook constantly bombards with my original cardkey picture from when I joined MS in 1996.

          I was a baby.  And boy, did I have a lot to learn…  I had no idea at all, how much I was going to be changed by the coming years.  I can see all of that in the picture.  It’s disconcerting :)

          Updated the Who is PowerPivotPro page with “then and now” pics if you want to see what I mean.


          Thank you Mariano!

          November 2, 2009

          PowerPivot CTP3 and Office Beta 2 have been troublesome beasts to download remotely off the corpnet.  Mariano to the rescue!  I got these on Saturday:

          PowerPivot DVDs

          Thanks man.  I really appreciate it :)