By Matthew Calder
Join our next Jump Start free online training event on November 14, featuring well known author Ed Bott and members of the Microsoft Windows team, who will show you how to migrate your organization from Windows XP or Windows 7 to Windows 8.1. You’ll find out about the new possibilities for mobile productivity, secure IT,and easy-to-manage infrastructure.
What’s New in Windows 8.1 for IT Professionals Jump Start
Date: November 14, 2013Time: 9:00am – 5:00pmWhere: Live, onlinevirtual classroomCost: Free!
You can download Ed Bott’s book Introducing Windows 8.1 for IT Professionals to start charting your upgrade path and get your questions ready to be answered by our experts live on November 14.
View this post online.
Just a reminder that there is still space available in this talk that is happening next week.
We’re pleased to announce the opening of registration for another Support Chalk talk. This month, Eric Fleck, from our Windows Store Developer Support team will spend some time giving you some tips and tricks around Enterprise Mobile Device Management.
The Windows Phone 8 Enterprise device management protocol documentation defines the processes which a Windows Phone 8 device will use to enroll and communicate with a device management service. In this talk we will be discussing diagnostic techniques to help developers identify common problems when writing a service which implements this protocol. Some topics we will cover are options for capturing network traces, analyzing XML payloads, and extracting encoded data. The demonstrations will only cover a portion of the time so there should be plenty of time to ask questions.
WHAT: Enterprise Mobile Device Management Implementation Common Issues
WHEN: November 13, 2013 11am-1pm PST
WHERE: Online Meeting
REGISTRATION: email Wsdsctreg@microsoft.com with the subject “November 13th Chalk Talk”. Meeting confirmation and logistics will be sent individually.
Hurry, space is limited to allow for interactive discussion! Please come prepared with your questions.
(Post courtesy Partner Solution Consultant Andre Kieft)
It has been a while since I created a blog post, but recently I received a lot of questions and requests for advice on how to migrate file shares to SharePoint and use SkyDrive Pro (SDP). So I figured to create a blog post with the things you need to consider as a Small and Medium Business (SMB) partner when you are planning to migrate file share content into SharePoint and want to make use of SDP for synchronizing the SharePoint content offline.
Note: that these steps are both valid for SharePoint 2013 on-premises (on-prem) and SharePoint Online (SPO).
As a first step, try to understand the data that resides on the file shares. Ask yourself the following questions:
Let me try to explain why you should ask yourself these questions.
If the total size of the file shares are more that the storage capacity that you have on SharePoint, you need to buy additional storage (SPO) or increase your disk capacity (on-prem). To determine how much storage you will have in SPO, please check the Total available tenant storage in the tables in this article. Another issues that may arise is that in SharePoint is that you reach the capacity per site collection. For SPO that is 100 Gigabyte, for on-premises the recommended size per site collection is around 200 Gigabyte. This would automatically mean that the content database is around 200 Gigabyte, which is the recommended size. Thought you can stretch this number up in on-prem, it is not recommended.
So, what should I do when my customer has more than 100 Gigabyte?
The total amount of files on the file shares is important as there are some limits in both SharePoint as well as SDP that can result in an unusable state of the library or list within SharePoint but you also might end up with missing files when using the SDP client.
First, in SPO we have a fixed limit of 5000 items per view, folder or query. Reasoning behind this 5000 limit boils all the way down to how SQL works under the hood. If you would like to know more about it, please read this article. In on-prem there is a way to boost this up, but it is not something we recommend as the performance can significantly decrease when you increase this limit.
Secondly for SDP there is also a 5000 limit for synchronizing team sites and 20000 for synchronizing personal sites. This means that if you have a document library that contains more that 5000 items, the rest of the items will not be synchronized locally.
There is also a limit of 5 million items within a document library, but I guess that most customer in SMB won’t reach that limit very easily.
So, what should I do if my data that I want to migrate to a document library contains more than 5000 items in one folder?
But wait! If I already have 5000 items in one folder, doesn’t that mean that the rest of the other document won’t get synchronized when I use SDP?
Yes, that is correct. So if you would like to use SDP to synchronize document offline, make sure that the total amount of documents per library in a team site, does not exceed 5000 documents in total.
So, how do I fix that?
Another limit that exists in SPO and on-prem is the maximum file size. For both the maximum size per file is 2 Gigabyte. In on-prem the default is 250 MB, but can be increased to a maximum of 2 Gigabyte.
So, what if I have files that exceed this size?
Another important aspect to look at on your file shares is the depth of nested folders and file length. The recommended total length of a URL in SharePoint is around 260 characters. You would think that 260 characters is pretty lengthy, but remember that URLs in SharePoint often has encoding applied to it, which takes up additional space. E.g. a space is one character but in Unicode this a %20, which takes up three characters. The problem is that you can run into issues when the URL becomes to large. More details about the exact limits can be found here, but as a best practice try to keep the URL length of a document under 260 characters.
So, what if I have files that will have more than 260 characters in total URL length?
When migrating file shares into SharePoint is often also a good momentum to clean up some of the information that the organization has been collecting over the years. If you find there is a lot of content which is not been accessed for a couple of years, what would be the point of migrating that data it to SharePoint?
So, what should I do when I come across such content?
Determine what kind of files the customer is having. Are they mainly Office documents? If so, then SharePoint is the best place to store such content. However, if you come across developers code for example, it is not a good idea to move that into SharePoint. There are also other file extensions that are not allowed in SPO and/or on-prem. A complete list of blocked file types for both SPO and on-prem can be found here.
So, what if I come across such file extensions?
In order to determine if you have large files or exceed the 5000 limit for example, you need to have some kind of tooling. There are a couple of approaches here.
So, now that we have analyzed our file share content, it is time to move them into SharePoint. There are a couple of approaches here.
If you are in a document library you can open up the library in the Windows Explorer. That way you can just do a copy and paste from the files into SharePoint.
But, there are some drawbacks using this scenario. First of all, I’ve seen lots of issues trying to open up the library in the Windows Explorer. Secondly, the technology that is used for copying the data into SharePoint is not very reliable, so keep that in mind when copying larger chunks of data. Finally there is also drag & drop you can use, but this is only limited to files (no folders) and only does a maximum of 100 files per drag. So this would mean if you have 1000 files, you need to drag them 10 times in 10 chunks. More information can be found in this article. Checking for invalid characters, extensions and URL length upfront are also not addressed when using the Open with Explorer method.
Pros: Free, easy to use, works fine for smaller amounts of data
Cons: Not always reliable, no metadata preservations, no detection upfront for things like invalid characters, file type restrictions, path lengths etc.
You could also use SDP to upload the data into a library. This is fine as long as you don’t sync more than 5000 items per library. Remember though that SDP is not a migration tool, but a sync tool, so it is not optimized for large chunks of data to be copied into SharePoint. Things like character and file type restrictions, path length etc. is on the list of the SDP team to address, but they are currently not there.
The main drawbacks of using either the Open in Explorer option or using SDP is that when you use these tools, they don’t preserve the metadata of the files and folder that are on the file shares. By this I mean, things like the modified date or owner field are not migrated into SharePoint. The owner will become the user that is copying the data and the modified date will be the timestamp of the when the copy operation was executed. So if this metadata on the files shares is important, don’t use any of the methods mentioned earlier, but use one of the third party tools below.
Pros: Free, easy to use, works fine for smaller amounts of data (max 5000 per team site library or 20000 per personal site)
Cons: No metadata preservations, no detection upfront for things like invalid characters, file type restrictions, path lengths etc.
Here are some of the 3rd party tools that will provide additional detection, fixing and migration capabilities that we mentioned earlier:
(Thx to Raoul for pointing me to additional tools)
The list above is in random order, where some have a focus on SMB, while other more focused on the enterprise segment. We can’t speak out any preference for one tool or the other, but most of the tools will have a free trial version available, so you can try them out yourself.
So, when should I use what approach?
Here is a short summary of capabilities:
1This depends on the capabilities of the 3rd party tool.
SDP gives me issues when synchronizing data Please check if you have the latest version of SDP installed. There have been stability issues in earlier released builds of the tool, but most of the issues should be fixed by now. You can check if you are running the latest version, by opening up Word-> File-> Account and click on Update Options-> View Updates. If your current version number is lower than the one you have, click on the Disable Updates button (click yes if prompted), then click Enable updates (click yes if prompted). This will force downloading the latest version of Office and thus the latest version of the SDP tool.
If you are running the stand-alone version of SDP, make sure you have downloaded the latest version from here.
Why is the upload taking so long? This really depends on a lot of things. It can depend on:
If you feel that there are things missing here, please let me know and I’ll try to add them to this blog post.
This week I had a fascinating conversation with a team of people at Microsoft that are dedicated to bringing you some really useful Windows Azure information. Mostly the kind that is based in reality, not theory. If you haven’t been over to this page before, check it out.
Also, if there is something you’d like to learn more about in a real-world context, please let us know in the comments below or email us: PartnerDevFeedback@microsoft.com.
Our friends from the support team have started a new series on Windows Azure Diagnostics. If you have 5 minutes, check this video out and stay tuned for future posts in the series.
Windows Azure Diagnostics (WAD) enables you to collect diagnostic data from Cloud Services running in Windows Azure. WAD fulfills two new diagnostic gathering requirements introduced by the Windows Azure scale-out architecture:
Save diagnostic data that would be lost during a reimaging of the instance.
Provide a central repository for diagnostics from multiple instances. Using windows azure diagnostics, you can collect diagnostics data off of multiple instances at once
Original Post: http://channel9.msdn.com/Series/DIY-Windows-Azure-Troubleshooting/WAD-Intro