 |
Blog
|
|
|

|
|
 |
Blog |
 |
| -->
 |
Posts Tagged ‘Performance’
Friday, March 16th, 2012
Here’s an evergreen question. It’s a question that never completely goes away. But lately, I’ve been getting it a few times per week. So I thought it’s time to readdress the question, which usually takes some form of the following:
I can’t really do effective development on my little dev laptop because our production SQL Server database is 15 gazillionbytes, way too big for my workstation. What’s a uber-nerd to do?
Well, maybe they didn’t use the word “uber-nerd”. But you get my drift, right? The production database is really, really big – unmanageably big for keeping a local copy. So that means the dev either has to create a metadata-only version of the database, which won’t produce realistic query plans, or somehow crush their laptop under 15 gazillionbytes of MDF and LDF files.
Actually, you have a better alternative – a clone database, sometimes called a shell database. Here’s how I described a cloned database a few years ago here in my Tool Time column for SQL Server Pro Magazine:
In effect, a cloned database includes all of the schema objects of the database (e.g., tables, views, stored procedures), as well as the statistics and histograms (the so-called “statistics blob”). This metadata is quite small by volume but can tell you what estimated query plans look like outside of a large production environment and how those estimated query plans might change when SQL Server is upgraded. Cloned databases are especially useful when the data is confidential, classified, or subject to privacy laws.
The article gives you all the detail you need to effectively and quickly create a small version of a big, ol’ production database that produces the same query execution plans as you’d get on the prod server.
If you’re struggling with doing development on a big SQL Server database, learn the ropes on cloned databases asap! You’ll be glad you did.
Enjoy!
-Kev
-Follow me on Twitter
Tags: Best Practices, DBA, Developer, Performance, Transact-SQL Programming Posted in Challenges, Cool Technologies, Databases, On-Line Resources, Performance, SQL Server, SQLMag, SQLServerPedia Syndication, Tips & Tricks, Tool Time, Transact-SQL Programming | 1 Comment »
Tuesday, March 6th, 2012
If you haven’t started to read Shashank Pawar (blog), you’re missing out. Shashank is part of Microsoft Australia and has been writing some very good content lately. Here’s an example from the Reference Architecture for High Performance SQL Server:
HP and Microsoft engineering teams have worked together to create a reference architecture to Accelerate Online Transaction Processing (OLTP) database workloads with a fully-flash based HP/Microsoft architecture and achieve significant performance increases, simplified database manageability, and industry leading TCO.
The details come in a torrent after that leading paragraph with lots of pretty pictures and charts to help explain. This is great stuff, especially for competitive platforms such as Oracle Exadata.
Read more about the new HP High Performance Reference Architecture for SQL Server 2012 here.
And just out of curiousity, are any of you using high performance architectures such as Oracle Exadata, IBM Netezza, or Teradata? I’d love to hear your feedback, questions, and comments.
Enjoy,
-Kev
-Follow me on Twitter
Tags: DBA, Oracle, Performance Posted in Architecture, Challenges, Cool Technologies, Databases, Hardware, IO, Performance, SQL Server, SQLMag, SQLServerPedia Syndication | No Comments »
Monday, October 31st, 2011
When you’re developing new Transact-SQL code or modifying some existing code, do you just launch directly into programming?
I know that I did just that, for years. It wasn’t until I was trying to performance tune some existing code that I realized I hadn’t actually taken caching of data and execution plans into account. So all those modified stored procedures that I was so proud of might not actually be faster than the first generation of procedures because I hadn’t checked to ensure that I was testing cached programs against uncached programs (and, by extension, the data used by those programs). That’s easy enough to fix with a test harness. Test harness were originally an actual, physical harness used by engineers to clamp down parts of an electrical or mechanical device they were prototyping. Ours is no different. It locks down all of the assumptions about our code (like my early, false assumption that I didn’t need to clear the caches) and adds a metric or two for good measure – literally – so we can better measure what’s happening in that code.
Here’s what my test harness looks like:
/* Transact-SQL test harness by Kevin Kline, http://KevinEKline.com, Twitter at kekline */
/* Flush dirty pages from the buffer to the database files. */
CHECKPOINT;
/* Flush the data cache and procedure cache, respectively. For DEV environments only! */
DBCC DROPCLEANBUFFERS;
DBCC FREEPROCCACHE;
/* Enable statistics tracking for IO and timings. Remember, SET commands remain enabled during a session until disabled. */
SET STATISTICS IO ON;
SET STATISTICS TIME ON;
-- Whatever SQL code you'd like to process goes below.
SELECT SalesOrderID
FROM Sales.SalesOrderHeader H
WHERE CustomerID = 344
GO
SET STATISTICS IO OFF;
SET STATISTICS TIME OFF;
/* Textual Execution Plans, if desired.
SET SHOWPLAN_TEXT ON;
SET SHOWPLAN_TEXT OFF;
*/
I also like to include the execution plans a lot of the time. You might wonder why I don’t save the execution plans for the GUI in SSMS? Well, I’m a big advocate of scripting in general because I like to automate activities. By pulling the execution plans using scripts, I can use SQLCMD to schedule a large number of query executions during the evening and have the results ready for analysis when I come back into the office in the morning. Workin’ smarter, not harder, Baby!
So how does this test harness work for you? Do you use other elements in yours? If so, share your experiences here!
Thanks,
-Kevin
-Follow me on Twitter
Tags: DBA, Developer, Performance, SQL Server 2008 R2, Tools & Scripts, Transact-SQL Programming, Troubleshooting Posted in Databases, On-Line Resources, Performance, SQL Server, SQLMag, SQLServerPedia Syndication, TCD blog post, Tips & Tricks, Tool Time, Transact-SQL Programming | No Comments »
Monday, August 8th, 2011
Back when my day-to-day duties included database administration work and enterprise architecture, I became rather obsessed with the idea of operational excellence. I read everything I could on the topic. I made a list of favorites, which became somewhat shabby over time, as I dog-eared important pages and scribbled notes in the margins. (Perhaps that list of favorites might, in and of itself, make a good blog post). Fast-forward a decade and I’m still mightily interested in operational excellence for IT organizations. It’s just that so much good material is available for free on the web.
Here’s a run-down of several useful documents and downloads to improve overall operation performance for those of you in a Microsoft-centric IT organization:
Microsoft Operations Framework
Microsoft Operations Framework (MOF) version 4.0 guide is practical guidance for IT organizations. With the release of version 4.0, MOF now reflects a single, comprehensive IT service lifecycle—it helps IT professionals connect service management principles to everyday IT tasks and activities and ensures alignment between IT and the business.
Infrastructure Planning and Design
The Infrastructure Planning and Design (IPD) guides are the next version of Windows Server System Reference Architecture. The guides in this series help clarify and streamline design processes for Microsoft infrastructure technologies, with each guide addressing a unique infrastructure technology or scenario.
Microsoft Baseline Security Analyzer 2.2 (for IT Professionals)
The Microsoft Baseline Security Analyzer provides a streamlined method to identify missing security updates and common security misconfigurations. MBSA 2.2 is a minor upgrade correct minor issues and add optional catalog support.
Security Compliance Manager
The Microsoft Security Compliance Manager provides centralized security baseline management features, a baseline portfolio, customization capabilities, and security baseline export flexibility to accelerate your organization’s ability to efficiently manage the security and compliance process for the most widely used Microsoft technologies.
Tags: Architecture, Best Practices, Compliance, DBA, Enterprise Architecture, Management, Operations, Performance, Security, SQL Server 2008 R2, Tools, Troubleshooting Posted in Administration, Architecture, Compliance, Cool Technologies, Hardware, On-Line Resources, Security, SQL Server, SQLMag, SQLServerPedia Syndication, Strategies, TCD blog post, Tips & Tricks, Virtualization | No Comments »
Tuesday, August 2nd, 2011
EPIC FAIL! This was supposed to go out last week. But I didn’t schedule it properly, so I’d just like to point out that there are lots of other great webcasts to watch at the Pragmatic Works webcast URL below. Plus, my session will be available via streaming by the end of the week. And thanks the the 1600 folks who registered!
-=-=-=-
Come join me on Tuesday, August 2, 2011 11:00 AM – 12:00 PM EDT for a free webcast covering the internals and architecture of Microsoft SQL Server. It’s not everyday that a dry topic like this is presented in a fun and easy to understand format, so get in while the gettin’ is good. :^)
Registration is free, thanks to the fine folks at Pragmatic Works.
REGISTER HERE
And don’t forget to check out all of Pragmatic Works’ other free webcasts. It’s great stuff and it’s FREE!
Enjoy,
-Kev
Follow me on Twitter
Tags: Best Practices, DBA, Developer, Internals, Monitoring, Performance, SQL Server 2008 R2 Posted in Administration, Databases, Presentations, SQL Server, SQLMag, SQLServerPedia Syndication | No Comments »
Wednesday, July 20th, 2011

Remote Desktop Services Component Architecture Poster
Grab your own poster! A visual guide to key Remote Desktop Services technologies in Windows Server 2008R2
Virtually Free
Get the latest update rollup package for the Hyper-V role in Windows Server 2008 R2 and be sure to bookmark the Windows Virtualization Team Blog. Be sure to check out blog World Simplified is a Virtual World. And doncha evah neglect application virtualization, such as the goodness at the App-V Product Team Blog.
Let’s Optimize Some Desktops (Assuming You Have Gone Full Cloud Yet)
Check out The Official Microsoft Desktop Optimization Pack (MDOP) Blog where you can get cool tools like the Diagnostics and Recovery Toolset (DART), currently in its v7 beta release.
We Can Always Perform a Little Better
Have you checked out the Ask the Performance Team blog yet. You should! Then there’s the Microsoft Enterprise Networking Team blog. And if you’re looking for help with the Windows Server Core, be sure to check out the Ask the Core Team blog. Excellent stuff!
As the Tool Time columnist at SQL Server Magazine, I’m always on the lookout for great free tools that get on-going support from their creators. One common experience is finding a nice debugging tool, only to discover that there’s no information on how to interpret the debugger result sets! (SQLIOSim anyone?) That’s why I love the Microsoft Advanced Windows Debugging and Troubleshooting blog. Another must-have on your Favorites list.
Enjoy!
-Kev
Follow me on Twitter
Tags: Best Practices, cloud computing, DBA, Debugging, Developer, Performance, SQL Server 2008 R2, Tools, Troubleshooting, Virtualization, Windows Posted in Administration, Cloud, Cool Technologies, Databases, On-Line Resources, Performance, SQL Server, SQLMag, SQLServerPedia Syndication, TCD blog post, Tips & Tricks, Tool Time | No Comments »
Monday, June 27th, 2011
First off – the Pain of the Week webcast series has been renamed. It’s now known as The Expert’s Perspective. Please join us for future webcasts and, if you’re interested in speaking, drop me a note to see if we can get you on the roster!
The bigger your databases get, the longer backups take. That doesn’t really seem like a huge problem — until disaster strikes and you need to restore your databases as fast as possible.
Join my buddy Brent Ozar (blog | twitter), a Microsoft Certified Master of SQL Server and good friend, as he reveals ways to make these critically important maintenance tasks run faster.
You’ll discover:
- Why Instant File Initialization is so important for restores
- How to use DMVs to check restore progress
- How to find the bottleneck while you’re backing up or restoring data
Watch the recorded presentation at http://www.quest.com/events/ListDetails.aspx?ContentID=13358!
Enjoy!
-Kev
Tags: Backup & Recovery, Best Practices, DBA, Performance, Video Posted in Administration, Databases, Performance, SQL Server, SQLServerPedia Syndication, Tips & Tricks | No Comments »
Tuesday, May 31st, 2011
Interested in my various performance tuning and troubleshooting videos about SQL Server? These videos feature my good buddies (and uber-SQL Server experts) Brent Ozar (blog | twitter) and Buck Woody (blog | twitter). View these insight-packed training videos from our SQL Server training events originally presented on March 3 and July 21 of 2010:HERE.
You can watch the videos now at the URL above or order a DVD, shipped free of charge in the USA and Canada, HERE.
Enjoy!
-Kev
~~~
Twitter at kekline
More content on my Blog
Tags: Best Practices, DBA, DMV, Internals, Monitoring, Performance, Quest Software, SQL Server 2008 R2, Video Posted in Administration, Challenges, Databases, IO, On-Line Resources, Performance, SQL Server, SQLMag, SQLServerPedia Syndication | No Comments »
Wednesday, April 27th, 2011

SSWUG.ORG’s virtual webcasts will prepare the “Accidental DBA” for patterns and practices they will experience in their role as a database administrator. I will provide easy-to-understand insights and realistic examples for professionals who have not had any formal DBA training. By the end of our four-part series, you should have the information needed to get up to speed on database planning, administration and performance tuning basics.
Session Descriptions
In the first session, you will see what is needed to fulfill the role of a (Database Administrator) DBA by learning more about what is typically expected of administrators and where the bulk of the work is done. Regardless if you are a draftee or volunteer to the position, the information applies to anybody wanting to better understand and fully own their title.
Over the course of the second session, you will find out why it is important to grasp some of the tips and tricks that DBAs have practiced for many years. I will emphasize about the need for documentation, testing, automation, sharing experiences and continuing your education.
During the third session, you will understand the reasons why the DBA is the sheriff in town! That’s why it’s important to know what you’re dealing with in your departments and inside your databases. I will explain how to inventory, determine what is not your responsibility, talk to your stakeholders, learn the business cycles and tackle important tasks.
The fourth and final session will emphasize the four essential skills needed to survive and excel in your database administration position – Communication, Troubleshooting, Benchmarking and Automation. I will explain how to leverage these abilities toward increased job security and professional successes.
· Wednesday, May 4, 2011, 11 a.m. – 12 p.m. PDT
· Wednesday, June 1, 2011, 11 a.m. – 12 p.m. PDT
· Wednesday, July 6, 2011, 11 a.m. – 12 p.m. PDT
· Wednesday, August 3, 2011, 11 a.m. – 12 p.m. PDT
Hope to see you there. REGISTER HERE.
Enjoy,
Tags: Career, DBA, Management, Performance, Professional Development, SQL Server 2008 R2, Training Posted in Administration, Challenges, Databases, Presentations, Professional Development, SQL Server, SQLMag, SQLServerPedia Syndication | No Comments »
Tuesday, March 1st, 2011
I would like to make you aware of a recently written paper by Bert Scalzo. The paper focuses on how DBAs can rely on the Toad and Benchmark Factory to perform database workload replays, ensuring that changes to the databases do not degrade the user experience.
White Paper: Integrating Workload Replays into Database Change Management
I encourage you to read the paper and make workload replay a part of your database change management practices. As I’ve been saying for years, if you don’t have quantitative evidence of what normal is for your database, how can you know what is abnormal?
Enjoy!
-Kev
Tags: Best Practices, DBA, Developer, Performance, Quest Software, Toad, Tools Posted in Challenges, Cool Technologies, Databases, Opinion | No Comments »
|
|
 |
|
|