Mat Stephen's SQL Server WebLog : Free SQL Server Tools, Utilities and Addins

SQL 2005 Metadata Samples Toolkit and whitepaper now available

Mat_Stephen — Tue, 03 Jan 2006 20:14:00 GMT

Reposted 10/1/06 to include in 'free tools' category

I'm constantly asked "what's Microsoft doing about metadata and do we have a solution."

In the old days (SQl 2000 and 7), Microsoft provided Meta Data Services, a platform designed to help tools and applications manage metadata and information models more effectively. It included the Open Information Model (OIM). A core model of sharable and reusable type descriptions. Microsoft worked with the Meta Data Coalition to publish the Open Information Model as an industry metadata model standard. Initially it was warmly received. However, soon after, a second set of companies in the Object Management Group proposed the Common Warehouse Metamodel (CWM) as a second standard for metadata. Metadata was everywhere!

But the excitement over cross-industry metadata models eventually wore off. For a variety of reasons, ISVs started to move away from industry-wide models and focused on point-to-point mappings between products (primarily focusing on XML-based exchange). The Meta Data Coalition merged with the OMG and cross-industry metadata modeling efforts have been stalled for several years. The world discovered Enterprise repositories and cross-product metadata models are very hard to integrate into existing computing environments (lots of custom applications and tools) and require lots of care and feeding for effective deployment and maintenance (i.e. lots of consulting).

So, Meta Data Services was deprecated in SQL 2005.

With SQL Server 2005 XML is every where, its used to describe all the really useful objects in the product stack. Consequently the possibilities to satisfy many of the needs, that metadata repositories are touted to solve, can now be easily solved by reporting off the XML that describes so many of the key components used in (Microsoft SQL Server) data warehousing (ie used by SSIS, SSRS and SSAS). The important aspects are data lineage, data dictionaries, auditing and impact analysis.

We are very pleased to announce the first incarnation of the "SQL Server 2005 Business Intelligence Metadata Samples Toolkit" http://www.microsoft.com/downloads/details.aspx?FamilyId=11DAA4D1-196D-4F2A-B18F-891579C364F4&displaylang=en. Along with the associated whitepaper http://www.microsoft.com/downloads/details.aspx?FamilyId=182BD330-0189-450C-A2FE-DF5C132D9DA9&displaylang=en it should now be possible to satisfy many of your metadata needs - simply and essentially for free!

The whitepaper also describes the importance of the new Extended Properties that can be applied to objects within the database - these can be used to store all sorts of business information including the all important data lineage and data definition.

New SQL 2005 code samples available

Mat_Stephen — Mon, 02 Jan 2006 20:15:00 GMT

I guess now the pressure is off to release the product we'll see more useful samples comming out of corp; here's a link to the latest December update:

http://msdn.microsoft.com/sql/downloads/samples/default.aspx

Feature Pack for Microsoft SQL Server 2005 - November 2005

Mat_Stephen — Mon, 28 Nov 2005 20:47:00 GMT

Overview

The Feature Pack is a collection of standalone install packages that provide additional value for SQL Server 2005. It includes:

Latest versions of redistributable components for SQL Server 2005
Latest versions of add-on providers for SQL Server 2005
Latest versions of backward compatibility components for SQL Server 2005

http://www.microsoft.com/downloads/details.aspx?familyid=d09c1d60-a13c-4479-9b91-9e8b9d835cdc&displaylang=en

Microsoft SQL Server 2005 Preview Software for UK customers

Mat_Stephen — Thu, 18 Aug 2005 14:25:00 GMT

If you're in the UK and you'd like to get your hands on the 'Microsoft SQL Server 2005 Preview Software' then please visit: http://www.microsoft.com/uk/windowsserversystem/sql/2005/evaluate.aspx

SQL Server Reporting Services Report Packs - looking for suggestions

Mat_Stephen — Tue, 16 Aug 2005 13:49:00 GMT

when I was over in the US recently, I attended a 'Bill Baker and team unplugged' session, (Bill is the GM for SQL Server Business Intelligence). Reporting Services Report packs came up as a topic for discussion. The team asked the audience if the Report Packs had been well recieved, to which I quickly responded 'yes', judging by the feedback I've had from my blog. So then we were asked to submit ideas for new Report Packs. If you have any suggestions for Report Packs you would like to see, submit them to me (via a comment would be good) and I will ensure they end up in front of the right person.

Get Ready for SQL Server 2005 with Free Microsoft E-Learning Courses.

Mat_Stephen — Fri, 29 Jul 2005 17:15:00 GMT

More and more people are asking me about SQL 2005 training courses and certification. I believe the exams will be ready in Q1 next year. In the meantme, how about access to the training courses absolutely free until 1st November @ https://www.microsoftelearning.com/sqlserver2005

SQL Server 2005 JDBC Driver Beta 1 Now Available

Mat_Stephen — Fri, 15 Jul 2005 15:02:00 GMT

Not many people know we have a SQL JDBC driver at all, well now we've got a beta version for SQL Server 2005. It works for a wide variety of OSs including: HP-UX, IBM AIX, Linux, Solaris, Windows 2000, Windows Server 2003, or Windows XP. Apparently it goes a lot better than the old (SQL 2000) driver (well we've written this one ourselves), and it will work against SQL 2000 to boot. You can find it here: http://www.microsoft.com/sql/downloads/2005/jdbc.mspx

The SQL Server 2005 JDBC Driver Beta 1 includes:

• Support for SQL Server 2000 & SQL Server 2005

• Support for JDBC 3.0

• Improved performance

• Improved XA transaction support

• BLOB and CLOB support

• Integrated authentication support

• Updateable result sets

Reporting Services: Two New (Free) Report Packs Released for Sharepoint and Axapta

Mat_Stephen — Thu, 14 Jul 2005 23:35:00 GMT

Good news for the chap I met on the 'Ask the Experts' desk at TechEd, who was contemplating jumping through all sorts of hurdles to create reports form Sharepoint data. I couldn't really get my head round the (Sharepoint) problems he foresaw, but I was able to tell him that a report pack was in the pipeline to do just what he wanted, without any agro. So here it is, along with a report pack for Axapta (about which I know almost nothing).

Overview of the Report Pack for Microsoft Office SharePoint Portal Server 2003

The Microsoft SQL Server Report Pack for Microsoft Office SharePoint Portal Server 2003 is a set of 8 Microsoft SQL Server 2000 Reporting Services reports that work with a sample database of information extracted from a SharePoint Portal Server environment. This database can be populated from your own SharePoint Portal Server environment using the downloadable Data Extraction Program (DEP). The DEP will read the SharePoint Portal Server data via the object model. You also can use the sample reports as templates for designing new reports.
This Report Pack includes the following reports: Storage Report, Storage Trend Report, Site Trend Report, Comprehensive Site Collections Report, Detailed Site Collection Report, Detailed Page Report, Best Bet Keyword, Search Terms.

You can download it here: http://www.microsoft.com/downloads/details.aspx?FamilyId=49159368-544B-4B09-8EED-4844B4E33D3D&displaylang=en

Overview of the Microsoft SQL Server Report Pack for Microsoft Axapta 3.0. This is a set of 8 predefined report definition files that work with a sample database from Microsoft Axapta. You can use the sample reports as templates for designing new reports.

This Report Pack includes the following reports: CRM Recap, Customer Order Delivery Performance, Open Production Orders, Open Sales Orders, Purchase Order Planning, Rolling Invoice, Sub Report - Inventory On Hand, Sub Report - Open Purchase Order Detail.

You can download it here: http://www.microsoft.com/downloads/details.aspx?FamilyId=81592B13-7960-4EF3-9D3C-B10FD325390F&displaylang=en

Querying and Reporting on Report Execution Log Data

Mat_Stephen — Wed, 22 Jun 2005 18:28:00 GMT

Well I didn't realise, or maybe I just plain forgot, that these reports and the necessary support infrastrucuture come with Reporting Services under the extras folder on the CD - all useful stuff for report heads.

Longest Running Reports
Most Executed Reports
Report Exections By Hour
Report Parameters
ReportsByMonth
ReportsByUser
ReportsExecutedByDay
ReportSize
ReportSuccessRate
Todays Reports

For more info see http://msdn.microsoft.com/library/default.asp?url=/library/en-us/rsadmin/htm/arp_rslogfiles_v1_88gy.asp?frame=true

Download Microsoft SQL Server 2005 Express Edition: Community Technology Preview April 2005

Mat_Stephen — Mon, 25 Apr 2005 06:36:00 GMT

Microsoft SQL Server 2005 Express Edition: Community Technology Preview April 2005

Download the Community Technology Preview (CTP) of Microsoft SQL Server 2005 Express Edition. Unlike beta releases that receive a much higher level of testing and feature work, CTPs are intended to expose the latest working build.

This CTP is feature complete and looks good

Additional code samples based on the Business Intelligence Portal

Mat_Stephen — Wed, 20 Apr 2005 16:38:00 GMT

Following on from my post http://blogs.technet.com/mat_stephen/archive/2005/02/01/364612.aspx that advertised the Business Intelligence Portal Sample Application for Microsoft Office. I have found we have also set-up a workspace on GotDotNet for the developer/partner community to assist each other and share additional code samples based on the Business Intelligence Portal. http://www.gotdotnet.com/workspaces/workspace.aspx?id=40063240-4d29-42d6-a163-47dcdf2efcaa. The workspace is private, so to become a member of this Workspace simply complete the application form.

Please note that this is not a supported product/solution from Microsoft. It is sample code that can be used to show customers/partners what is possible with Microsoft products and technologies for Business Intelligence.

Feature comparison: Microsoft SQL Server 2000 Reporting Services vs Business Objects Crystal Reports / Crystal Enterprise

Mat_Stephen — Fri, 15 Apr 2005 11:10:00 GMT

At last, here is a feature comparison between Microsoft SQL Server 2000 Reporting Services vs Business Objects Crystal Reports / Crystal Enterprise that I can actually point you to. We've had our own internal one for quite sometime, but for what I believe are legal reasons, I haven't been able to share it with you.

So, I'm grateful to Certia for producing this objective, public, un-sponsored, third party comparison of the two products.

Naturally I hope Certia will publish a similar paper after the release of SQL Server 2005.

http://baadd.org/uploads/SQL%20Reporting%20Services%20vs%20Crystal%20Reports%20comparative%20analysis.pdf

Two new free Microsoft SQL Server Reporting Services Report Packs released for IIS and Great Plains

Mat_Stephen — Mon, 04 Apr 2005 09:12:00 GMT

From the blog hits I received the last time I posted some info on free report packs available for SQL Server Reporting Services, I'm sure many of you will be pleased to find we've just posted two more for IIS and Great Plains.

Objective:

The Report Packs provide customers with templates of commonly used reports from which users can easily modify for their own reporting needs. These report packs were designed to:

· highlight the benefits of SQL Server Reporting Services

· demonstrate Microsoft cross-product synergies

· assist customers shortent report design and development

New Report Packs:

The two report packs contain 20 sample reports and two sample databases.

1. IIS Logs Report Pack

· Free sample IIS reports include most popular Website, browser statistics report, etc.

· Download URL: http://www.microsoft.com/downloads/details.aspx?FamilyID=2805d337-14c7-40e3-820b-e7ee653c68c0&DisplayLang=en

2. MBS Great Plains 8.0 Report Pack

· 8 sample reports created by Great Plains Product Team

· Fee sample MBS Great Plains reports include sales commission, inventory value reports, etc.

· Download URL: http://www.microsoft.com/downloads/details.aspx?FamilyID=5d3ed4c9-d7bf-47eb-bc73-6dd72f9d57ad&DisplayLang=en

Microsoft SQL Server - Reporting Services Scripter - a free tool from sqldbatips.com

Mat_Stephen — Tue, 22 Mar 2005 01:58:00 GMT

I’m grateful to Andy Steer of Contemporary, one of our Gold BI Partners here in the UK, for pointing me to this useful free utility from.sqldbatips.com

Overview:

Reporting Services Scripter is a .NET Windows Forms application that enables scripting of all Microsoft SQL Server Reporting Services catalog items to aid in transferring them from one server to another. It can also be used to easily move items on mass from one Reporting Services folder to another on the same server. Depending on the scripting options chosen, Reporting Services Scripter can also transfer all catalog item properties such as Descriptions, History options, Execution options (including report specific and shared schedules) and server side report parameters.

http://www.sqldbatips.com/showarticle.asp?ID=62

If you have any feedback, remember its always welcome

Microsoft SQL Server Resource Kit tools - 'Free' with MSDN and TechNet

Mat_Stephen — Wed, 02 Mar 2005 01:59:00 GMT

Okay so these tools aren't totally free but I didn't really have anywhere else to categorise them. Anyway I'm sure I've seen advertisements that boast "you can get a ‘free’ toy with every packet of some breakfast cereal". Well these tools are ‘free’ with a subscription to MSDN SQL Server CD/DVD or TechNet Resource Kit CD/DVD and they’re very handy. Check them out below in this excerpt from the kit - maybe there's one you always wanted.

Some of you maybe aware that the SQL Server 2000 Resource kit used to be a separately purchasable item – however today I learnt from Allen, who pinged me an email, that this book is no longer in print. You can find text of the resource kit @ http://www.microsoft.com/resources/documentation/sql/2000/all/reskit/en-us/default.mspx - and this is free

Bulk Image Insert (BII)
One of the most frequently recurring questions in the support newsgroups is how to deal with image fields in SQL Server, and you'll find a comprehensive chapter on this topic. Particularly interesting is the section on "lessons learned" in implementing Microsoft's TerraServer project (http://www.terraserver.microsoft.com, the "world's largest online satellite imagery gazeteer"). Not only does the chapter explain in comprehensive detail different ways to access BLOB information, it also includes the BII utility that's part of TerraServer. BII lets you automatically import images into a database using a system that's reminiscent of bcp, but this utility imports the image files, or any binary file, defined in the import file, and not only the file's path.

Administration stored procedures
The kit includes a collection of audit-trail stored procedures to detect situations such as these:

· Clustered indexes defined in columns wider than a specific length (sp_rk_audit_clustered_wide)

· Suspicious settings at that server or database level (sp_rk_audit_configure and sp_rk_audit_dboptions)

· Use of SQL-89 syntax for outer joins (sp_rk_audit_old_outer_joins)

· Any database objects with owners other than the dbo (sp_rk_check_non_dbo_owned_objects)

· Any specific Table settings, such as pin table (sp_rk_tableoption)

To install these procedures, I recommend you read the installation process available in Chapter 34, because it's not as obvious as it might seem.

Analysis Services Thin Web Client Browser
There's also a useful example of a Thin Web Client showing an OLAP cube (see Figure 3), where you can get a good idea of how to use JavaScript to manipulate a cube from a Web interface. Be careful to provide the correct server name, database name, and cube name when you run this utility, though, because the default values probably won't match your installation.

Catalog Explorer
The Catalog Explorer is an example of how to write a VB application to show the meta data of OLAP objects. The application uses ADOMD and ADO, and the result is simple and efficient, as shown in Figure 4.

Data Mining Visual Toolkit
SQL Server 2000 Analysis Services includes data mining algorithms, and the Resource Kit provides a demo developed by Angoss Software Corporation (http://www.angoss.com), which shows how to use these algorithms in a commercial application. The information can show decision trees (as in Figure 5), cluster models, and liftchart models. [Angoss sells a Data Mining SDK for SQL Server 2000 and the KnowledgeSTUDIO SDK for developers, along with a variety of other related packages for end users and enterprises.—Ed.]

Digital Dashboard
With the new .NET initiative and the advent of Knowledge Management (KM) systems, designing Digital Dashboards is an increasingly popular way of developing information portals. Note that this new Digital Dashboard kit can't be installed in a domain controller. (It took me a while to realize why it didn't install until, in desperation, I decided that it was time to read the documentation. Sound familiar?)

Database Hammer
The Database Hammer is similar to the previous version's SQL Load Simulator, but Database Hammer is a VB app that you can customize. (The old utility was a multithreaded app that connected to SQL Server via ODBC, while this one uses OLEDB to connect to SQL Server from multiple instances of a VB component and inserts 10 million rows of random data into a test database.)

Database Generator
The Database Generator has been improved from the previous version. This utility allows you to create test data in a database, selecting the data distribution criteria for each column (see Table 1).

Table 1. Data distribution criteria.

Distribution	Parameters
EXPONENTIAL	Mean, offset
SELF-SIMILAR	Num, Height, Min, Max
UNIFORM	Min, Max
NORMAL	Mean, Deviation
UNIQUE	Start
IDENTITY	Start
HYPEREXPONENTIAL	Mean, Variance, Offset
ERLANG	Mean, Variance, Offset
POISSON	Lambda, Offset
ZPIF	Num, Theta, Min, Max
RANDOM
DOMAIN	Table_name, Sampling_column, Identity

Federated Toolkit Sample
The Federated Toolkit Sample is a very didactic example that uses an n-tier design based on SQL Server 2000 Distributed Partitioned Views (DPV) and two COM+ components: a data services component and a routing component. Using the demo Inventory application, you can see how a distributed application can benefit from using DPVs, and you can use this example as a template to develop more complex applications.

Meta Data Scripter
If you never learned how to use Decision Support Objects (DSO), the Meta Data Scripter sample provides an example of how to use this useful library. Using this sample application, you can fully script an OLAP server to a VBScript file—something that can come in handy when you want to re-create the same complete or partial structure in a different server.

Desktop Engine Administration
Another recurring question sent to the SQL Server support team and the public newsgroups is, "How can I administer MSDE? Why doesn't MSDE have an Enterprise Manager?" If you've ever asked these questions, the Resource Kit provides you with a sample application you can use to create an Access application to programmatically administer SQL Server. Figure 6 shows the Desktop SQL Server Configuration tool, giving you access to all configuration settings in SQL Server. I don't consider this tool a replacement for Enterprise Manager, but it does its job in situations where the only tools available are Access and MSDE, or the Desktop Engine. The SQL Jr. Admin tool, as you can see in Figure 7, provides a similar approach, but using SQL-DMO in this case. The technique used in SQL Jr. Admin can be very useful to create an administration tool that exposes only the features that a particular administrator needs to use.

Sample Resolver
Teaching the SQL Server Administration courses, I always have some students asking about how Merge Replication deals with conflicts, and I used to answer with the typical "You can write your own conflict resolvers using VB to cover your specific needs." Frankly, I'm glad I've always had a response such as a knowing chorus of "Ah!" because it's not that simple—at least it isn't something you'd want to explain (or try to absorb) on a Friday afternoon. The Sample Resolver application shows how to use the Conflict Resolver Library, included in SQL Server 2000, to create your own merge replication resolver using VB. This sample shows how to implement two resolvers: the Additive Resolver and the Minimum Resolver.

Simple Log Shipper
One of the main features of the previous Resource Kit was LogShipping. This is now a standard feature in SQL Server 2000, but in some scenarios, this tool can be a bit too complex to use. The Simple Log Shipper tool is a very simple solution, implemented entirely in T-SQL, and is suiTable for systems that require fault tolerance without very much administration overhead.

Stored Procedure Builder
Developers who are working in teams often work with some versioning control tool, such as Visual SourceSafe, but using this tool to control creation of stored procedures and versioning typically requires using Visual InterDev, which, frankly, isn't very natural for SQL Server programmers. [See David Brennan's May 2001 article, "Script Writing in Hollywood," for an alternative that doesn't require Visual InterDev.—Ed.] The Stored Procedure Builder utility works with the Visual SourceSafe repository.