Thanks again to Kate Kurtz who is guest blogging for me this week as a first time attendee & presenter at IDUG.
Today was my last full day at IDUG. There are still some sessions tomorrow, but I have an early flight, so I won't be able to attend any of them. I really hope I can make it back to IDUG next year - it was an amazing experience and I had a wonderful time. I am already thinking of topics! :-)
First up today was Haider Rizvi's session on "IBM Smart Analytics System - A Technical Update". Haider invited me to cover a section in that presentation as well, and it was great to have another opportunity to present and participate in the customer discussions. I covered the overview section, and then Haider did a deep dive into the architecture and design of the IBM Smart Analytics System. The people in the room loved it, and there were a lot of questions about the system design and how to plan for system growth with multiple generations of an IBM Smart Analytics System.
Later on in the day I attended Albert Grankin's session, "DB2 LUW Operational Performance Troubleshooting - Finding CPU Bottlenecks". Albert's session was very detailed, giving a thorough overview of the tools you can use for performance analysis, as well as really good case study through which he illustrated how to use all the utilities he introduced in the first part of his session. There was also some solid common sense tips:
- Make sure you collect baseline information so you know what "normal" is for your environment.
- Plan a data collection strategy - don't wait until you have a problem.
I also attended Chris Eaton's session, "Workload Optimized Systems: Don't Run a Marathon in High Heels". A great title and a great session! Chris' session was a competitive analysis of Oracle Exadata, the IBM pureScale Application System and the IBM Smart Analytics System. I asked Chris afterwards if he would be willing to give this session again, for our development teams, since I think it would be interesting for them, and also useful to understand the market in which our products compete. (He said yes :-) Chris is in the Speaker Hall of Fame for IDUG, and I paid a lot of attention to how he presented his sessions, as it was a great chance for me pick up some tips from an expert speaker.
One of the best parts of the day was the number of customers that stopped me to ask a question in the hall, at lunch or in the expo. I really enjoy getting to meet new people, and having a chance to talk about data warehouse, best practices, DB2, IBM Smart Analytics System ... Well, it was just a lot of fun. The ideas were all interesting, and there were a lot of people here who had passion for their work and that led to some great conversations.
After all of that, I finished the day participating in a Special Interest Group: IBM DW Trends - LUW, z/OS and Netezza. This session was an informal discussion group where customers could come in and ask anything they wanted about data warehousing. There was a panel of experts - Beth Hamel (z/OS), Namik Hrle (z/OS), Haider Rizvi (IBM Smart Analytics System/DB2 LUW), Michael C Lee (Netezza) - and then the not-so-expert me :-), all there to discuss whatever came up. There were a lot of questions about the Smart Analytics Optimizer for z/OS, as well as Netezza.
It really was a privilege to be able to attend IDUG and have the core concepts of pureScale, IBM Smart Analytics System, DB2 LUW and DB2 for z/OS explained by the people who developed the code and designed the systems.
Thanks Kate! I don’t have much to add today… just a couple of things:
- I’ve been getting twitter messages about the lack of a bookstore this year. If you missed the bookstore, make sure you put it on your feedback forms, and maybe I’ll be able to come next year to show you all the books that are available.
- If you are a member of IDUG, you can get 45% off IBM Press books? Find out more: http://ibm.co/fhR46O
- Get Certified for Free at IDUG in the Grand Ballroom A & B. Open 7:30 to 11:00 Friday. New exam 617 (DBA for z/OS) is available.
- For more live coverage of the IDUG conference, see Leon Katsnelson’s blog entries, check out the DBI Live Feed, the IDUG Daily Summary, and of course the best blog aggregotor, http://planetdb2.com/.
Another guest post from Kate Kurtz who is attending IDUG for the first time. I’m really glad that she’s doing this for me as I can’t be there this year.
Phew! The time is flying by and my only regret is that I do not have enough time to attend all the sessions. I also should have brought more comfortable shoes! Today I was lucky enough to get to see Matt Huras (Distinguished Engineer, DB2 Development) speak. He was discussing "The latest from the Lab and Customers on DB2 pureScale".
Matt was able to take a complicated concept and explain it in a simple straightforward way, making it easy to understand. In his session he mapped all the things that you know about how to manage a traditional DB2 LUW environment, to how they are implemented in DB2 pureScale, and the differences. The management concepts are straightforward, and wherever possible processes are automated. The complicated part (which does not affect the user) is the technology behind the scenes that makes it all work. With a simple, straightforward manner and excellent automated build slides, Matt made all the technology easy to understand.
Recently there have been some best practice papers published for DB2 pureScale, so if you want to read more, take a look:
In the afternoon, Kelly Rodger and I ran the session "Best Practices for Your Database Recovery Strategy". It was lively session with lots of questions from the audience. As you can imagine, database recovery planning is something that people are very passionate about. All the concepts that we covered in the session are discussed in detail, in the best practice paper: "Building a Recovery Strategy for an IBM Smart Analytics System Data Warehouse". We also added some additional content about compression which we plan in incorporating in the next update to the paper.
The presentations are amazing and IDUG is excellent networking opportunity. In addition to that, while you are IDUG you can take the DB2 Certification exams for free. What a great opportunity to test what you know!
A note about the certifications at IDUG. Roger Sanders has a new book for DB2 9.7 Certification Exams coming soon. We were hoping it would be done for IDUG, but alas. The latest DB Magazine has an article about Roger & certification that you might want to read.
Susan Lawson and Dan Lutsetich have also updated their DBA Certification for DB2 10. The book will be ready in June, so check back for ordering information.
For more live coverage of the IDUG conference, see Leon Katsnelson’s blog entries, check out the DBI Live Feed, the IDUG Daily Summary, and of course the best blog aggregotor, http://planetdb2.com/.
PS… speaking of Roger Sanders, I’m reviewing the last chapter for his upcoming book “From Idea to Print”. See a blog entry I wrote about part of the book: Campus Visit: How to improve technical writing skills. Anyway, the chapter I’m reading is about the author contract and how to best negotiate the terms so that they are favourable to the author. I am completely blown away by the content and think that this chapter alone will sell the book!
Another entry from Kate Kurtz who is attending & presenting at IDUG for her first time.
Wow! What a day. It has gone by so fast, and yet it felt incredibly slow while it was happening. There is just so much to take in, and so much to learn.
The key note speaker was Jeff Jonas, founder of SRD and now Chief Scientist, Entity Analytics. His topic was "Sensemaking on Steams and What Makes Smart Systems Smart". He is a phenomenal speaker with lots of energy and passion about what he does. It was a great session. He also managed to start and end his keynote speech with a poop joke. You have to admire someone who can do that and also deliver an amazing talk about fascinating technology. If you are interested in learning more, check out his blog here -> http://jeffjonas.typepad.com/. I think that the research he does has just entered on my list "Cool jobs I wish I did at IBM". Don't get me wrong, I love what I do, but I am often amazed by the type of work people do at IBM and the sheer variety of interesting things to learn about.
The first session, Warehouse Best Practices in Action - The IBM Smart Analytics System, went well and there were lots of questions from the audience. I love that , it is much more fun to have a conversation with the audience than it is just talk all by yourself. I also learn a lot from the types of questions people ask. I was co-presenting with Eddie Daghelian, and Haider Rizvi was there as well, so the discussion was lively and very educational for everyone. I did a lot of informal surveys of the audience, and it was interesting, most people could remember the days of DB2 PE (parallel edition), most were taking on-line backups, but very few of them were exploiting the table space level backup and restore functionality. There were a lot of questions and curiosity about Work Load Management, and also about Data Ingest strategies.
I think that is the best part about IDUG - a bunch of people who are really interested in technology, all getting together and just having a conversation. The presentation was really just a jumping off point, as for the rest of the day I had customers coming up to me asking for more information about specific topics in the presentation.
And, on a closing note, I want to say Thank You to Rebecca Bond, Steve Rees, and Calisto Zuzarte, who all made the time to attend the session and were friendly faces I could look for through out the presentation. Thanks Guys - it was hugely helpful to see you there!
I’ve heard Jeff Jonas speak several times and completely agree with Kate that he is phenomenal! During and after Jeff’s keynote, the comments were flying in on twitter about his talk. If you want to keep up with what’s going on, I highly suggest that you open this URL: http://bit.ly/mO4svB.
I copied some of my favourite tweets and posted them on Jeff’s FB wall:
Jeff Jonas opened and closed the keynote with a poop story and in the process told everyone how to make sense of data. Brilliant!
- #IDUGNA opening session....worth the full conference fee by ITSELF ! #DB2
Jeff’s response: I spent 7 hours creating a one of a kind deck for today's 60 minute keynote. Glad someone liked it!
Speaking of Jeff, Kate gave a link to his blog, and I encourage you to read it. Also, here is a recent interview with Jeff along with a very cool video "200 countries in 200 years". http://bit.ly/lVW9ME
Apparently there was a retirement party for Roger Miller last night as well. Another reason I really wish I was able to join my IDUG friends in California this year!
I wish I was in California with my IDUG friends… Kate, Rebecca, Scott, Leon, Eddie, Kermit, and others! Not just for the learning and company, but to get away from this constant spring rain we are getting.
Kate sent me a note today to tell me about her first day at her first IDUG:
Anaheim is beautiful! The weather is sunny, with a clear blue sky and WARM! A big difference from the cold wet rain I left behind in Toronto.
The flight down was great, and it is unbelievable how much work you can get done in 4 hours when you don't have a network connection. I spent most of the flight reviewing presentations and making small updates. Last week, Simon Woodcock kindly reviewed my session and spent some time listening to me practice. He had some really good suggestions, so luckily I was able to spend the flight down making some last minute changes and quietly rehearsing in my head.
I also read the latest draft of the Workload Management Best Practice Paper - which is looking really good. I also made some changes to the Warehouse Recovery Planning session, adding in some of the usability slides that were put together based on the Triton Consulting study that was done. (Thanks Rick Sobesiak!)
Tomorrow To Do List:
- Register for the conference & plan what sessions I want to see
- Meet with Eddie Daghelian for further presentation tuning & practice
- 3:15 - present! (Susan, send me your best wishes, ok? I know I should not admit this, but I am kind of nervous...)
- 4:30 video taping session
I'll let you know how my presentation goes tomorrow :-)
I’m hoping to post again today to tell you about what’s going on with the certification team. I do have some book news to go with that, but more on that later.
For more live coverage of the IDUG conference, see Leon Katsnelson’s blog entries, check out the DBI Live Feed, the IDUG Daily Summary, and of course the best blog aggregotor, http://planetdb2.com/.
by Toby Teorey, Sam Lightstone, Tom Nadeau, and H.V. Jaqadish
Published Feb 24, 2011.
(Note that the amazon.com price is currently 40% off the regular price. Not sure how long this will be the case, so if you want the book, buy it soon!)
Yes, the 5th edition! A book only gets updated this often if it is REALLY good and REALLY popular. Have you read any of the editions yet? I’ve seen the book for sale at conferences, but haven’t read it yet.
A whole chapter devoted to XML and web databases. What you need to know to utilize XML rather than relational tables.
A whole chapter describing Object Relational Design. Learn how to make a choice between what is in the database as a BLOB and what is outside in a separate file.
About the book:
Database systems and database design technology have undergone significant evolution in recent years. The relational data model and relational database systems dominate business applications; in turn, they are extended by other technologies like data warehousing, OLAP, and data mining. How do you model and design your database application in consideration of new technology or new business needs?
In the extensively revised fifth edition, you'll get clear explanations, lots of terrific examples and an illustrative case, and the really practical advice you have come to count on--with design rules that are applicable to any SQL-based system. But you'll also get plenty to help you grow from a new database designer to an experienced designer developing industrial-sized systems.
- In-depth detail and plenty of real-world, practical examples throughout
- Loaded with design rules and illustrative case studies that are applicable to any SQL, UML, or XML-based system
- Immediately useful to anyone tasked with the creation of data models for the integration of large-scale enterprise data.
I copied a couple of reviews from amazon.com to give you an idea of the book’s value:
"Database Modeling and Design is one of the best books that I have seen for explaining how to build database applications. The book is informative, well-written, and concise."-Michael Blaha, DSc., Consultant, Modelsoft Consulting Corp
"This book book is by far the best book available on classic database design. Topics like normalization and many-to-many and n-ary association semantics are without peer in teaching you how to model real-world complexities. This latest edition extends the classic material with extensive discussion of modern tools and other aspects of logical database design. Every database architect should have this book at hand."-Bob Muller, Data Analyst, Poesys Associates
About the authors:
I only know author Sam Lightstone, so let me tell you a bit about him. He works in the IBM Toronto Lab and is a master inventor in the database area. Last year he published his first non-database book, called “Making it Big in Software”. The book is quite successful and is highly recommended if you are in the software business in any role.
Here are some previous blog entries about Sam & his Making it Big book:
Campus visit - how to improve technical writing skills
Wine and Cheese and Sam Lightstone at IOD
Meet author Sam Lightstone “Making it Big in Sofware”
Making it Big .... Live on the DB2Night Show!
Two live sessions coming up with author Sam Lightstone...
Making it Big in Software
Sadly I’m not at IDUG this year. I’ll definitely miss many very special people, the education, the networking, and the dine around event. For those of you who are there, let us know how it is going, and get full use out of your visit!
My good friend Kate Kurtz is attending IDUG this year. It is her first time and she is presenting a session. I’ve asked her to guest blog for me while the conference is going on. This is the first of her entries. I hope you enjoy:
My name is Katherine Kurtz, and it is my first time going to IDUG!
Susan invited me to write some guest blogs, to give the inside scoop on the various sessions at IDUG and what the experience is like. I work with a great team of people developing best practices for the IBM Smart Analytics System and InfoSphere Warehouse Environments, and I am currently a manager for DB2 and IBM Smart Analytics System Information Development.
I really believe that we should educate people - ourselves and our customers - about the best way to use our products, which is how I ended up submitting several sessions to IDUG. (Note to self: Be careful what you ask for! Preparation for IDUG was about 5x more work than I expected). Best Practices are all about taking what is tried and tested in the field, putting it together with the future directions our development team is working on and then working together to make a great product even better.
I love what I do - and it is great to always be learning.
It is the night before I leave and I am currently building my checklist.
- presentations ready? check (well - maybe not quite, I think I still want to tweak a few things)
- packed? check
- American $$ , just in case I get to go shopping... :-) check
What will I be doing while I am at IDUG?
I have two sessions I am co-presenting. Warehouse Best Practices In Action - The IBM Smart Analytics System and also Best Practices for Building a Recovery Strategy for your Data Warehouse. I was also asked to participate in a Special Interest Group panel discussion, focusing on Data Warehousing. I am sure there will be lots of interesting debate - and I hope I can think on my feet! There is also the first timer luncheon on Wednesday - where I get to go as an IDUG first timer and as an IBMer, plus I get food, which is always a good thing.
One of the things I liked the most about IOD last fall (which was also the first time I attended IOD) was the conversations I had with customers I met during different sessions. It was always interesting to hear their point of view, and I think it really changes the way I think about the products that we are developing. I hope IDUG will be the same way - lots of great discussions, and chance to learn a lot from others.
If you are attending IDUG, please be sure to stop by and say hi,
Thanks Kate! Looking forward to hearing more from you.
Others who are at IDUG and are blogging include:
Rebecca Bond: What do your car keys, Nemo and IDUG NA have in common?
There already seems to be a lot of traction for the hash tag #IDUG, so I put together a web page that searches for Twitter updates containing #IDUG. It’s pretty cool: http://bit.ly/kW3MoM or http://www.dbisoftware.com/idugna11.php
This tracks something like the newest/most recent 50 tweets, 8 second continuous updates.
Cristian Molaro: DBBuzz
See my previous entries about the conference. If you are there and would like me to blog about your experiences, let me know :)
Just a bit more about IDUG
Guest blogger: Beth – What IDUG Sessions are recommended in the DB2 for z/OS track?
All about IDUG DB2 Tech Conference - Anaheim
Rebecca Bond: IDUG NA – The Geeky Vacation!
Budgeting for IDUG North America conference as viewed by the DB2 Locksmith
PS… If you see Roger Miller, please give him a big kiss goodbye as he is retiring very soon …
This week’s show took place today… and I missed it! I thought I still had an extra day to promote it. So, if you’re like me and missed the show, you can listen to the replays. Here’s what happened in the past week:
Thursday April 21
The DB2Night Show #50: Put on the Boxing Gloves, DB2 LUW vs Oracle, Part 1
Julian Stuhler from Triton Consulting and Rick Sobiesiak of IBM Canada presented findings from their DB2 LUW versus Oracle Usability study. The study examines the major differences between DB2 9.7 and Oracle 11gR2, and assesses the complexity of each. Very impressive results, which I’ll let you discover by reading the study or watching the replay.
Round 1: Installation
Round 2: Data Compression
Round 3: Index Compression
Round 4: Backup & Recovery
If you want to see the complete study, down load the free Whitepaper: Quantitative Complexity Analysis.
Get the commentary and the replay. In the commentary, you’ll find links to several blog entries that were written in conjunction with this study.
Monday April 25
The DB2Night Show #Z01: The history of DB2 for z/OS
The launch of the DB2 for z/OS version of the DB2Night Show hosted by Klaas Brant. The first show featured special guest Roger Miller who spoke of the history of DB2. Klaas mentions in his wrap up of the show that there were many things mentioned that he wasn’t aware of even though he had been using DB2 since V1.2. Also, this show marks the last visit Roger will make on the DB2Night Show as he will retire in a few weeks. Roger, you’ll be missed!!
Get the commentary and the replay.
Thursday April 28
The DB2Night Show #51: Put on the Boxing Gloves, DB2 LUW vs Oracle, Part 2
Julian Stuhler and Rick Sobiesiak continued presented findings from their DB2 LUW versus Oracle Usability study. Make sure you make it known as to which of the tasks covered in either show you’d like to see demonstrated on a future DB2Night Show.
Round 5: Memory Tuning
Round 6: Data Access Control
Interesting comments & questions that came up during the show:
- Scott recommended that audience members also check out The DB2Night Show #14: Crunching the Numbers and DB2 STMM.
- Question from the audience whether IBM is making DB2 so easy to put DBAs out of business or to give DBAs a chance to improve their golf game.
- Question from the audience: why is Oracle so popular if DB2 is so great?
- Many questions on STMM.
There were so many questions today, but they will be answered in the Replay Blog.
Get the commentary and the replay.
Next week: IDUG.
And, the week after IDUG:
Monday May 9
The DB2Night Show z/OS Edition #02: DB2 for z/OS Now and into the Future
Jeff Josten will share the latest news with DB2 z/OS V10 and offer his insights into what may be coming next in DB2 z/OS: The Future of DB2
Friday May 13
The DB2Night Show Episode #52 - : DB2 for LUW Best Practices: Writing and Tuning Queries for Optimal Performance
John Hornibrook from the IBM Toronto Lab will spend 90 minutes to give his query optimization talk. John is also back for another show taking place on Friday May 20. Since that is so long from now, check out a previous show with John that was ranked one of the best of the first season: Episode 11. DB2 9.7 Optimizer Updates with special guest John Hornibrook from IBM.
As always, a great learning and entertainment opportunity via the DB2 Night Show. Thanks Scott! Good luck in Nashville on the marathon.
Today marks the first day of the new blog by David Birmingham called “Netezza Underground”. As you may remember, IBM purchased Netezza not that long ago. To refresh your memory, here is a description in the Press Release, IBM Completes Acquisition Of Netezza:
Netezza data warehouse appliances bring analytics directly into the hands of business users within every department of an organization such as sales, marketing, product development and human resources. The simplicity of deploying Netezza appliances makes the technology ideal for the needs of high-performance analytics, requiring minimal administration and IT skills, and enables clients to run complex data queries within days of deploying the solution.
David’s first blog entry introduces the need for the blog and looks at the counter-intuitive nature of the product's internals. In future entries, he’ll answer questions about the technology as a seasoned expert. If you’re interested in business analytics, data warehousing, and big data, this is definitely a blog that you want to subscribe to.
So, who is David? He’s not an employee of IBM or Netezza. David is a consultant working for Bright Light Consulting and is a huge fan of the Netezza product and architecture. A few years ago he also wrote a Netezza book:
Looking for more information about Netezza? Here are some additional resources that I’ve found:
- IBM Red Guide: The Netezza Data Appliance Architecture: A Platform for High Performance Data Warehousing and Analytics
- Netezza Community – links to David’s blog, plus other bloggers, including Jim Baum, Justin Lindsey, Phil Francisco, Brad Terrell, Shawn Dolley, Dai Clegg, and Patricia Colter.
- Enzee Universe – User Conference taking place in Boston June 20-22.
I’m looking forward to learning more about Netezza via David’s blog.
This may be the best 23 pages you’ll ever read about DB2 LUW Database Storage. This updated paper just went live and was updated by Aamer Sachedina, Matthew Huras, and Robin Grosman.
In a world with networked and highly virtualized storage, database storage design can seem like a dauntingly complex task for a DBA or system architect to get right. Poor database storage design can have a significant negative impact on a database server. CPUs are so much faster than physical disks that it is not uncommon to find poorly performing database servers that are significantly I/O bound and underperforming by many times their potential.
The good news is that it is not necessary to get database storage design perfectly right. Understanding the innards of the storage stack and manually tuning the location of database tables and indexes on particular parts of different physical disks is neither generally achievable nor generally maintainable by the average DBA in today’s virtualized storage world.
Simplicity is the key to ensuring good database storage design. The basics involve ensuring an adequate number of physical disks to keep the system from becoming I/O bound.
This document provides basic initial suggestions for a healthy database server through easy-to-follow best practices in database storage, including guidelines and recommendations.
See also my previous posts on Best Practices:
Best Practice Resources for DB2 z/OS
DB2 Best Practices – New or Updated in 2011
And also see the Flashbooks co-authored by Aamer & Matt:
DB2 pureScale: Risk Free Agile Scaling
Thanks again to Kate Kurtz for giving me this information. She also tells me there is one more to publish before IDUG.
OK, I thought I had produced a pretty good list of free resources, but of course, as soon as I post, I realize that I’ve forgotten to mention some really key resources. Let me try again and hope that I don’t miss anything else! (Of course if I do… please tell me!!)
PlanetDB2.com – Allow us to filter through all the blogs that are on the web to bring you only the bloggers that talk about our favourite subject: DB2, InfoSphere, Warehouse, and other Information Management technologies.
ChannelDB2.com – The single largest community of people working on DB2 and Information Management products, world-wide. You’ll be able to build your network of professionals who work in your country or who are interested in the same technology as you. The best feature is the incredibly large selection of videos of people presenting about this products. Once in awhile, save your eyes and tune into these videos.
DB2Express-C – Maybe you’ve just heard of DB2 or maybe you use a competitor’s product. No worries… give DB2 a try for free. Find out for yourself how easy it is to learn and how much better it is than the product you may be using.
Information Center – Perhaps I’m biased since I worked for 6 years on the Information Development team that produces product documentation, but I really think you’ll find the completeness and the quality of this information to be outstanding. All of the information is online, for every release, for free, and is updated regularly. The benefit of the content being online is that you can search and easily find the information you need.
developerWorks – You’ll find more articles, blogs, tutorials and other training resources than you could possibly consume in a lifetime! The link I’ve provided is for the DB2 Professional Community, but you’ll be able to find technical information about all IBM software products. Endless :)
MeetDB2 – One of the interesting things you’ll find on developerWorks is this utility that will help you analyze your Oracle database to estimate the level of compatibility with DB2. My link will take you to an article written by Serge Rielau that will help you understand how the utility works, and it provides a link the utility.
Read through my previous blog entries for more free or almost free resources:
Not quite free….
DB2Night Show - DB2 for z/OS