NAK DOCTORAL PROGRAM EVALUATION
Frequently Asked Questions
Frequently Asked Questions
Faculty Data Questions
Question: We had a faculty member join us for the first time during the fall 2019 semester. How do I count this person in the system?
Count all scholarly work that the person has done for the variables listed for the years 2015-2019 even if they did not work in your department for all of that time period.
Question: We have a person in a post-doctoral position. How does this person count in the faculty listing?
The person does not count. The evaluation is looking at full-time, tenured or tenure-earning faculty members in your program.
Question: A faculty member joined us two years ago (2017) but held a faculty position at another institution prior to coming to our Department. How do we count that person?
Count all scholarly work that the person has accomplished during the period 2015-2019.
Question: Our college Dean holds a faculty appointment in our unit. Should I count the Dean as a member of the faculty?
Yes, as long as the Dean meets the faculty inclusion criteria listed on Page 3 of the “Instructional Guide.”
Question: Three of our faculty members co-authored a peer-reviewed paper. Does this count as three publications or one publication?
This publication is counted only once. The variable (Journal Publications) is unique publications from the program.
Question: I have a faculty member who was a Fellow in NAK during the 2015 year but has let their membership lapse. How do I count that?
You would not include this person for this item (NAK Fellow), as they were not an active NAK Fellow in 2019.
Question: How do I include a faculty member who joined our faculty in Spring 2020?
Do not include this faculty member, only include faculty who were members of the faculty for Fall 2019.
Question: How do I include an emeritus faculty member?
Do not include this faculty member, only include faculty who were members of the faculty for Fall 2019. At least 25% of the faculty member’s base salary must come from support that is provided by the academic unit sponsoring the doctoral program.
Question: A faculty member had a paper accepted for publication in the fall of 2019, can this be included as a publication?
The crucial criteria here is the date of publication for the final archival version of the publication. Consider, what in two years time will the year of publication be for this publication? If that date is after 2019 it would not be counted in this review. While accepted, has the paper been published? Some journals make papers available on-line (often not formatted or with page numbers) prior to publication, in this case this publication would not count.
Question: Do these questions/information need to be completed for the entire department or can we just submit information for one part of the department? For example, can information be sent for exercise science but not sports management?
Generally, the evaluation will cover the department. Most departments offer a single doctoral degree program in kinesiology or sports science. It is not our intent to evaluate sub-disciplines within the major (e.g., biomechanics, exercise physiology, motor behavior, sport psychology, etc.).
Within a university, however, more than one program may be evaluated separately. In such situations these programs would typically fall under separate administrative structures, have unique sets of faculty members, different criteria for admissions/programs, and faculty tend not to share student program teaching and advising.
Question: How to count abstracts of presentations?
Abstracts of presentations (e.g., oral and poster) are not counted as publications, but presentations at national or international meetings are counted.
Question: How should the bibliography be formatted?
The bibliography should be in two sections: Journal Publications and Book Publications. The publications be listed in alphabetical order, in the APA format. It is anticipated that most programs will exploit bibliographic software for collating and formatting these references. The final submitted file should be a Word© file.
Frequently Asked Questions
Unit Funding Questions
Question: For the "funded" categories, should I record a dollar amount expended, or the number of funded grants/contracts/training programs/etc.?
The total dollar amount processed through the unit/department budget each year should be listed.
Question: Do the "funded" categories include research contracts as well as grants?
Yes. Contracts should also be listed if they are expenditures processed through the unit/department budget. Federal and other external sources should be separated into the respective categories.
Question: How do I report grants that are not just for research (i.e., they are combination grants - combined research and research/training) as well as straight research training grants. The grants are from large foundations. Would they count?
Grants are grants, not necessarily research grants, as long as they are expenditures processed through the departmental budget. Training grants, research, contracts, etc. would count. The key differentiations are between federal, non-federal, and internal.
Frequently Asked Questions
Student Data Questions
Question: We have a student who enrolled in the program during the fall 2016 semester but dropped out without completing any coursework. Do I include him/her as a student?
Question: Student support is to be reported. We are asked to "Enter the total number of FTE for which your unit has graduate student support for the calendar year 2019 (Spring, Summer, & Fall).”. FTE, by definition, means full time equivalent (FTE). However, none of our graduate students have full-time appointments (i.e., 100%). Most of our project assistants, research assistants, teaching assistants, etc. are usually 50% or half time. Some go as low as 1/3 time, and that is the threshold for waiver of out-of-state waivers and other benefits. Should we count two students who have standard 50% appointments as 1/2 time, with the understanding that the two students combined would have one FTE?
Yes, two 50% people would be added to make 100% (i.e., 1 FTE). Three 0.33 FTE would make 1 100% FTE, etc. One 100% plus two at 0.50 FTE plus a 0.33 would sum to 2.33 FTE.
Question: Some of our students are on 12 month contracts but others on 9 month contracts. When computing their FTE, how should this be done?
If a student is on 100% time for 12 months, that would be 1.00 FTE. A student on a 100% time for 9 months would be 0.67 FTE. Many student are on 50% appointments therefore, for example, a 9-month appoinment would be equal to a 0.375 FTE.
Question: A student graduated and accepted a post-doctoral position for two years. The student then accepted a tenure-track faculty line. How many times do I count this person under employment?
Count the person only once. In this case, count the person as accepting a Post-doctoral position. These data relate to the first position acquired by the doctoral student once graduated.
Question: Does GA support include both masters and doctoral level or only those supported at the doctoral level?
Yes, include both masters and doctoral students who are supported.
Question: Under the Student support section, do we include all sources of graduate support when we report FTEs (e.g., grants, etc.) as well as those funded by our own department?
Yes, include all Graduate Assistants/Research Assistant/Teaching Fellows/Teaching Assistants/etc. that are funded at the masters and doctoral levels in the program from all sources of funding.
Question: Student X was enrolled as a doctoral student in our program from 2010-2016 and she had a first-authored research paper published in a refereed journal in 2018 based on data that were collected during her enrollment period. Does this publication count under “Number of Publications”?
(a) she was first author of the research paper published in a refereed journal;
(b) her enrollment period puts her in the eligible group (i.e., doctoral students who were enrolled full-time during at least one year of the evaluation period, in this case 2016);
(c) the paper was published during the evaluation period (i.e., 2015-2019); and
(d) the publication was during her eligible time period (i.e., two years after graduation).
Question: Student Y first enrolled as a doctoral student in our program in 2015 (and is currently in the program) and she has a first-authored research paper published in a refereed journal from 2015 based on data that were collected during her enrollment period. Does this publication count under “Number of Publications”?
(a) she was first author of the research paper in a refereed journal;
(b) her enrollment period puts her in the eligible group (i.e., doctoral students who were enrolled during at least one year of the evaluation period);
(c) the paper was published during the evaluation period (i.e., 2015-2019) and,
(d) given that she has not yet graduated the publication was during her eligible time period (i.e., two years after graduation).
Question: Two students are enrolled in our program; Student A is completing a master’s program and has been accepted for the doctoral program (and has completed some doctoral courses during the master’s enrollment period), and student B is in the doctoral program. They are the sole authors on a research paper published in 2019. Student A is the first author and Student B is the second author. Does this paper count under “Number of Publications”?
No, because the first author is not currently enrolled in the doctoral program.
Question: We have students with GRE scores from the old scale (200-800) and others with the new GRE scale (130-170). How do we report these?
Use the new scale (130-170) for all students included. A GRE Conversion chart is available from ETS at https://www.ets.org/s/gre/pdf/concordance_information.pdf.
Question: When computing “Mean GRE scores” do we report these for students in the program in the fall 2019, or for all students in the program for the calendar year 2019?
When computing the mean values use data from all full- and part-time students enrolled in your doctoral program in the 2019 calendar year (spring, summer and/or fall, 2019).
Frequently Asked Questions
Question: What are the indices used to evaluate the doctoral programs?
There are two overall indices,
1) Faculty data which contribute 66% to the overall score.
2) Student data which contribute 34% to the overall score.
The breakdown of these components are,
Faculty Indices (66%)
Journal publications 20%
Federal research funds 15%
Non-federal research funds 8%
Internal grant funds 3%
Editorial Boards 6%
National Academy Kinesiology Fellow 2%
Other Fellowships 2%
Students Indices (34%)
GRE verbal 5%
GRE quantitative 5%
Graduate Assistant Support 13%
Doctoral publications 2%
Postdoctoral positions 4%
Employment in the field 3%
Question: When will the results be released?
The results will be released September 26, 2020 at the NAK Annual Meeting. Subsequently the results will be posted to the NAK website (http://nationalacademyofkinesiology.org/).