I have to confess that I’m incredibly excited about BigData. I haven’t been this excited about new innovations in IT since relational databases first appeared on the scene early in my career. But what is BigData?
Back in those days, I can still feel the echos of adrenaline when I was hired to work on a NASA project that would involve over 100Mb of data. ONE HUNDRED MEGABYTES! Good grief, that was fantastically huge to us on the team. (That database was over 130Mb when I finally moved on to another project). And remember – PC software was installed using 640Kb floppy disks at the time. In fact, my Oracle v5 instance required shuffling through about a dozen floppy disks to get the thing installed on a 286 IBM PC.
BigData today takes on an entirely meaning as database sizes scale into the petabytes. But the emphasis is still the same today as it was back in the 1980′s – turning data into actionable information. However, with BigData, we can achieve amazing new insight from this data and mine for tidbits that would never have seen the light of day with smaller data sets.
The two major themes to remember about big data are 1) the more data you have on a given domain, the more power you have, 2) the better the analysis you can perform on the data, the more power you have. In fact, theme 2 might be the most important thing to consider because lots of data is meaningless unless you can extract knowledge from it. And that’s where better analytical techniques come into play.
Here are some articles about Big Data that you might enjoy:
First off – the Pain of the Week webcast series has been renamed. It’s now known as The Expert’s Perspective. Please join us for future webcasts and, if you’re interested in speaking, drop me a note to see if we can get you on the roster!
The bigger your databases get, the longer backups take. That doesn’t really seem like a huge problem — until disaster strikes and you need to restore your databases as fast as possible.
Join my buddy Brent Ozar (blog | twitter), a Microsoft Certified Master of SQL Server and good friend, as he reveals ways to make these critically important maintenance tasks run faster.
You’ll discover:
Why Instant File Initialization is so important for restores
How to use DMVs to check restore progress
How to find the bottleneck while you’re backing up or restoring data
The article, titled “Real World NoSQL: HBase at Trend Micro,” is the first in a five-part series Guy wrote, spotlighting NoSQL (non-relational) database deployments at five different companies. The other good learning experience for me was hearing about GigaOm for the first time. GigaOm, now on my reading list, is considered an influential and prestigious publication in the NoSQL realm.
Interested in my various performance tuning and troubleshooting videos about SQL Server? These videos feature my good buddies (and uber-SQL Server experts) Brent Ozar (blog | twitter) and Buck Woody (blog | twitter). View these insight-packed training videos from our SQL Server training events originally presented on March 3 and July 21 of 2010:HERE.
You can watch the videos now at the URL above or order a DVD, shipped free of charge in the USA and Canada, HERE.
I first wrote about Mladen Prajdic’s excellent tool in my Tool Time column at SQL Server Magazine HERE. The tool is a nice plug-in to SSMS and definitely worth having. If you’ve never installed it or have only installed an older version, but sure to pick up the newest release. Here’s Mladen’s press release complete with hyperlink for the tool: SSMS Tools Pack 1.9.4 is out! Now with SQL Server 2011 (Denali) CTP1 support.
As Mladen says:
…this release adds support for SQL Server 2011 (Denali) CTP1 and fixes a few bugs. Because of the new SSMS shell in SQL 2011 CTP1 the SSMS Tools Pack 1.9.4 doesn’t have regions and debug sections functionality for now. The fixed bugs are: A bug that prevented to create insert statements for a database A bug that didn’t script commas as decimal points correctly for non US settings….
There are so many great tools out there for data professionals using Microsoft SQL Server. I really like to see all of these great tools made free to the public. On the other hand, I’m bummed that the tools are cast about in a very decentralized fashion. If you haven’t done migrations before, you might want to start with these good white papers first.
Here are a hand full of cool migration tools worth mentioning:
SQL Server Migration Assistant (SSMA) for Oracle: Migrate from Oracle to SQL Server 2005, SQL Server 2008 or SQL Server 2008 R2. I’m thinking about installing it on my SQL Servers even without even needing to migrate existing Oracle databases to SQL Server. Why? Well as an old Oracle hand, I came to really enjoy quite a few Oracle PL/SQL system packages (kind’a like a SQL Server system stored procedure, but often more powerful). As it turns out SSMA-Oracle includes stored procedures, extended stored procedures, and CLR routines that reproduce the functionality in most all of the cool and powerful Oracle packages like DBMS_PIPES. It’d be nice to have those on my SQL Servers just because I know them and like them.
Microsoft Services for Mission Critical Customers: Many enterprise customers running mission critical applications on SQL Server have asked for more – more service and support for their environments. This is an add-on that costs extra, but it’s worth it for those running the systems that keep the company in business.
If you’ve tried any of these tools out, I’m keen to hear your experiences. Did they work well for you? Did they work, though poorly? Did they fail utterly? Inquiring minds want to know.
I had a very interesting conversation recently with a good friend of mine. She’s at the top of her game as a first class enterprise DBA in a major medical institution. She was interested in my career advice because she’d recently received an unsolicited invitation for a higher paying job in the business intelligence (BI) field. While I won’t talk much more about the specifics of that conversation, it’s not a unique conversation. In fact, I gave an interview to SearchSQLServer.com a while back about how DBA career paths are more and more leading into an even better paying career in business intelligence. Check out the interview HERE.
Many thanks to Microsoft SQL Server MVP Andy Leonard (blog | twitter) for conducting a series of interviews of prominent SQL Server types, including me. The interview found here.
SSWUG.ORG’s virtual webcasts will prepare the “Accidental DBA” for patterns and practices they will experience in their role as a database administrator. I will provide easy-to-understand insights and realistic examples for professionals who have not had any formal DBA training. By the end of our four-part series, you should have the information needed to get up to speed on database planning, administration and performance tuning basics.
Session Descriptions
In the first session, you will see what is needed to fulfill the role of a (Database Administrator) DBA by learning more about what is typically expected of administrators and where the bulk of the work is done. Regardless if you are a draftee or volunteer to the position, the information applies to anybody wanting to better understand and fully own their title.
Over the course of the second session, you will find out why it is important to grasp some of the tips and tricks that DBAs have practiced for many years. I will emphasize about the need for documentation, testing, automation, sharing experiences and continuing your education.
During the third session, you will understand the reasons why the DBA is the sheriff in town! That’s why it’s important to know what you’re dealing with in your departments and inside your databases. I will explain how to inventory, determine what is not your responsibility, talk to your stakeholders, learn the business cycles and tackle important tasks.
The fourth and final session will emphasize the four essential skills needed to survive and excel in your database administration position – Communication, Troubleshooting, Benchmarking and Automation. I will explain how to leverage these abilities toward increased job security and professional successes.
I’ve always appreciated how Andy Warren (blog| twitter) operates in the most transparent manner, especially as it relates to his role as a director for the Professional Association for SQL Server. For example, Andy’s latest blog post about prepping for the SQLRally, to kick off in less than 30 days, is insightful and gives you a good idea of the sort of work a strong director for PASS needs to put in. I also enjoy how Andy more or less thinks out loud and offers you the chance to provide your input. In that latest blog post, he was mulling different after hours entertainment options, giving you a chance to pipe up with your opinion if you had one.
Learn from My Mistakes
Times running out for the early registration discount. Save $50 by registering before the end of the week! And while you’re at it, register for my full day, pre-conference seminar on learning leadership and management skills especially tailored for the IT professional. Here’s a quick run-down of the topics we’ll cover in my pre-con:
Earning the respect of your team
A deep understand of effectively motivating technology professionals
Specific skills to lead database professionals competently that broadly fall into the categories of:
Coaching team members to effectively meet goals and deadlines
Facilitating change and navigating organizational disruptions
Promoting communication within the team and with management
Keeping teams and projects on task and within scope
Dealing with difficult team members
Practicing good team time management techniques
Read all about the goals of the session here. If you’re coming to my session, I’d love to hear your thoughts ahead of time about challenges you’re facing!
Personal Experience, Personnel Experience
Also, just a word about my bona fides. I’ve had a lot of leadership and management training over the years, but like many professionals I consider my on-the-job experiences to be the most valuable.
On the education side of the equation, I received a bachelor’s degree in the school of management back in the 1980′s. I’ve also gone through the Center for Creative Leadership‘s leadership training curriculum, the Blessing and White Management Training curriculum, and SmithBucklin’s not-for-profit governance and organizational strategy training curriculum. On the experience side of the equation, I led small dev and admin teams of 3-7 people starting way back in the early 1990′s. In the late 1990′s, I started taking a more strategic direction with my skills as the manager of information architecture at the firm where I worked as well as taking a role as one of the founding directors of PASS. In the early 2000′s, I joined Quest Software as our initial SQL Server product architect and spent several years leading the team to a over 50 individuals in a half dozen teams in as many disparate locations around the world.
A Few Words About Community from SQLBits8
The more I go, the more reasons I find to go back to the SQLBits conferences held around the UK. The starting image isn’t very flattering, but here’s a fun little interview put together by Andrew Fryer of Microsoft:
