Treatment planning is time-consuming and the outcome depends on the person performing the optimization. A system that automates treatment planning could potentially reduce the manual time required for optimization and could also provide a method to reduce the variation between persons performing radiation dose planning (dosimetrist) and potentially improve the overall plan quality. This study evaluates the performance of the Auto-Planning module that has recently become clinically available in the Pinnacle3 radiation therapy treatment planning system. Twenty-six clinically delivered head and neck treatment plans were reoptimized with the Auto-Planning module. Comparison of the two types of treatment plans were performed using DVH metrics and a blinded clinical evaluation by two senior radiation oncologists using a scale from one to six. Both evaluations investigated dose coverage of target and dose to healthy tissues. Auto-Planning was able to produce clinically acceptable treatment plans in all 26 cases. Target coverages in the two types of plans were similar, but automatically generated plans had less irradiation of healthy tissue. In 94% of the evaluations, the autoplans scored at least as high as the previously delivered clinical plans. For all patients, the Auto-Planning tool produced clinically acceptable head and neck treatment plans without any manual intervention, except for the initial target and OAR delineations. The main benefit of the method is the likely improvement in the overall treatment quality since consistent, high-quality plans are generated which even can be further optimized, if necessary. This makes it possible for the dosimetrist to focus more time on difficult dose planning goals and to spend less time on the more tedious parts of the planning process.