{"id":23894,"date":"2025-03-01T07:00:00","date_gmt":"2025-03-01T12:00:00","guid":{"rendered":"https:\/\/cehhs.utk.edu\/elps\/?p=23894"},"modified":"2026-01-30T07:58:15","modified_gmt":"2026-01-30T12:58:15","slug":"is-your-data-dirty-the-importance-of-conducting-frequencies-first","status":"publish","type":"post","link":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/","title":{"rendered":"Is Your Data Dirty? The Importance of Conducting Frequencies First"},"content":{"rendered":"\n
<\/div>\n\n\n\n

By Jennifer Ann Morrow, Ph.D.<\/strong><\/p>\n\n\n\n

\"\"<\/figure>
\n

Data, like life, can be messy. I\u2019ve worked with all types of data, both collected by me and by my clients, for over 25 years and I ALWAYS check my data before conducting my proposed analyses. Sometimes, this part of the analysis process is quick and easy but most of the time it\u2019s like an investigation\u2026you need to be thorough, take your time, and provide evidence for your decision making.\u00a0<\/p>\n<\/div><\/div>\n\n\n\n

<\/div>\n\n\n\n

Data Cleaning Step 3: Perform Initial Frequencies<\/strong> <\/p>\n\n\n\n

After you have drafted your codebook<\/a> and analysis plan<\/a> you should conduct frequencies on all of your variables in your dataset, both numeric and string variables. I typically use Excel<\/a> or SPSS<\/a> to do this, my colleague Dr. Louis Rocconi<\/a> prefers R<\/a>, but you can use any statistical software that you feel most comfortable with. At this step I conduct frequencies and request graphics (e.g., bar chart, histogram) for every variable. This output will be invaluable as you work through your next data cleaning steps. <\/p>\n\n\n\n

So, what should you be looking at when reviewing your frequencies? One thing that I will make note of is any discrepancies in coding between my data and what is listed in my codebook. I\u2019ll flag any spelling issues in my variable names\/labels and note anything that doesn\u2019t match my codebook. One thing that I always check is that my value labels (what labels are given to my numeric categories) are the same as my codebook and consistent across sets of variables. Many times, if you are using an online survey software package to collect your data there can easily have been programming mistakes when creating the survey that results in mislabeled values. Also, if you have had many individuals enter data into your database it can increase the chances that mistakes were made during the data entry process. During this step I will also check to make sure that I have properly labeled any values that I\u2019m using to designate missing data and that this is consistent with what I have listed in my codebook.  <\/p>\n\n\n\n

Lastly, I will highlight when I see variables that may have extreme scores (i.e., potential outliers), variables with more than 5% missing data, and variables with very low sample size in any of their response categories. I\u2019ll use this output in future data cleaning steps to aid in my decision making on variable modification. <\/p>\n\n\n\n

Data Cleaning Step 4: Check for Coding Mistakes<\/strong> <\/p>\n\n\n\n

At this step I will take my output that I highlighted potential issues with coding and start reviewing and making variable modification decisions at this step. Coding issues are more common when you have data that has been manually entered but you can still have coding errors in online data collection! Any variables that have coding issues I first determine if I can verify the data from the original\/another source. For data that has been manually entered I\u2019ll go back to the organization\/paper survey\/data form to verify the data. If it needs to be changed to the correct response I will make a note of this to fix in my next data cleaning step. If I cannot verify the datapoint (like when you have collected your data anonymously) and the value doesn\u2019t fall in the possible values listed in my codebook then I make a note to set the value as missing when I get to the next data cleaning step.  <\/p>\n\n\n\n

Additional Advice<\/strong> <\/p>\n\n\n\n

As I am going through my frequencies I will highlight\/enter notes directly in the output to make things easier as I move forward through the data cleaning process. I\u2019ll also put notes in my project notebook summarizing any issues and then once I make decisions on variable modifications, I note these in my notebook as well. You will use the output from Step 3 in the next few data cleaning steps to aid in your decision making so keep it handy! <\/p>\n\n\n\n

<\/div>\n\n\n\n

Resources<\/strong><\/p>\n\n\n\n

12 Steps of Data Cleaning Handout: https:\/\/www.dropbox.com\/scl\/fi\/x2bf2t0q134p0cx4kvej0\/TWELVE-STEPS-OF-DATA-CLEANING-BRIEF-HANDOUT-MORROW-2017.pdf?rlkey=lfrllz3zya83qzeny6ubwzvjj&dl=0<\/a> <\/p>\n\n\n\n

Step 1: https:\/\/cehhs.utk.edu\/elps\/organizing-your-evaluation-data-the-importance-of-having-a-comprehensive-data-codebook\/<\/a> <\/p>\n\n\n\n

Step 2: https:\/\/cehhs.utk.edu\/elps\/clean-correlate-and-compare-the-importance-of-having-a-data-analysis-plan\/<\/a> <\/p>\n\n\n\n

https:\/\/davenport.libguides.com\/data275\/spss-tutorial\/cleaning<\/a><\/p>\n\n\n\n

https:\/\/libguides.library.kent.edu\/SPSS\/FrequenciesCategorical<\/a><\/p>\n\n\n\n

https:\/\/www.datacamp.com\/tutorial\/tutorial-data-cleaning-tutorial<\/a><\/p>\n\n\n\n

https:\/\/www.geeksforgeeks.org\/frequency-table-in-r<\/a><\/p>\n\n\n\n

https:\/\/www.goskills.com\/Excel\/Resources\/FREQUENCY-Excel<\/a><\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

By Jennifer Ann Morrow, Ph.D. Data, like life, can be messy. I\u2019ve worked with all types of data, both collected by me and by my clients, for over 25 years and I ALWAYS check my data before conducting my proposed analyses. Sometimes, this part of the analysis process is quick and easy but most of […]<\/p>\n","protected":false},"author":86,"featured_media":23696,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_eb_attr":"","inline_featured_image":false,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[44],"tags":[],"class_list":{"0":"post-23894","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-utkmadblog","8":"entry"},"acf":[],"yoast_head":"\nIs Your Data Dirty? The Importance of Conducting Frequencies First - Educational Leadership and Policy Studies<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Is Your Data Dirty? The Importance of Conducting Frequencies First - Educational Leadership and Policy Studies\" \/>\n<meta property=\"og:description\" content=\"By Jennifer Ann Morrow, Ph.D. Data, like life, can be messy. I\u2019ve worked with all types of data, both collected by me and by my clients, for over 25 years and I ALWAYS check my data before conducting my proposed analyses. Sometimes, this part of the analysis process is quick and easy but most of […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/\" \/>\n<meta property=\"og:site_name\" content=\"Educational Leadership and Policy Studies\" \/>\n<meta property=\"article:published_time\" content=\"2025-03-01T12:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-30T12:58:15+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2240\" \/>\n\t<meta property=\"og:image:height\" content=\"1260\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Jonah Hall\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jonah Hall\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/\"},\"author\":{\"name\":\"Jonah Hall\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#\\\/schema\\\/person\\\/6bfd2c32cad7f6a411dfcf7e5dd65055\"},\"headline\":\"Is Your Data Dirty? The Importance of Conducting Frequencies First\",\"datePublished\":\"2025-03-01T12:00:00+00:00\",\"dateModified\":\"2026-01-30T12:58:15+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/\"},\"wordCount\":759,\"image\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/07\\\/New-MAD-Blog-Design-Final-1-3.jpg\",\"articleSection\":[\"Evaluation Methodology Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/\",\"name\":\"Is Your Data Dirty? The Importance of Conducting Frequencies First - Educational Leadership and Policy Studies\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/07\\\/New-MAD-Blog-Design-Final-1-3.jpg\",\"datePublished\":\"2025-03-01T12:00:00+00:00\",\"dateModified\":\"2026-01-30T12:58:15+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#\\\/schema\\\/person\\\/6bfd2c32cad7f6a411dfcf7e5dd65055\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/07\\\/New-MAD-Blog-Design-Final-1-3.jpg\",\"contentUrl\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/wp-content\\\/uploads\\\/sites\\\/9\\\/2024\\\/07\\\/New-MAD-Blog-Design-Final-1-3.jpg\",\"width\":2240,\"height\":1260},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Is Your Data Dirty? The Importance of Conducting Frequencies First\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#website\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/\",\"name\":\"Educational Leadership and Policy Studies\",\"description\":\"University of Tennessee, Knoxville\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/#\\\/schema\\\/person\\\/6bfd2c32cad7f6a411dfcf7e5dd65055\",\"name\":\"Jonah Hall\",\"url\":\"https:\\\/\\\/cehhs.utk.edu\\\/elps\\\/author\\\/jhall152\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Is Your Data Dirty? The Importance of Conducting Frequencies First - Educational Leadership and Policy Studies","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/","og_locale":"en_US","og_type":"article","og_title":"Is Your Data Dirty? The Importance of Conducting Frequencies First - Educational Leadership and Policy Studies","og_description":"By Jennifer Ann Morrow, Ph.D. Data, like life, can be messy. I\u2019ve worked with all types of data, both collected by me and by my clients, for over 25 years and I ALWAYS check my data before conducting my proposed analyses. Sometimes, this part of the analysis process is quick and easy but most of […]","og_url":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/","og_site_name":"Educational Leadership and Policy Studies","article_published_time":"2025-03-01T12:00:00+00:00","article_modified_time":"2026-01-30T12:58:15+00:00","og_image":[{"width":2240,"height":1260,"url":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3.jpg","type":"image\/jpeg"}],"author":"Jonah Hall","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jonah Hall","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/#article","isPartOf":{"@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/"},"author":{"name":"Jonah Hall","@id":"https:\/\/cehhs.utk.edu\/elps\/#\/schema\/person\/6bfd2c32cad7f6a411dfcf7e5dd65055"},"headline":"Is Your Data Dirty? The Importance of Conducting Frequencies First","datePublished":"2025-03-01T12:00:00+00:00","dateModified":"2026-01-30T12:58:15+00:00","mainEntityOfPage":{"@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/"},"wordCount":759,"image":{"@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/#primaryimage"},"thumbnailUrl":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3.jpg","articleSection":["Evaluation Methodology Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/","url":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/","name":"Is Your Data Dirty? The Importance of Conducting Frequencies First - Educational Leadership and Policy Studies","isPartOf":{"@id":"https:\/\/cehhs.utk.edu\/elps\/#website"},"primaryImageOfPage":{"@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/#primaryimage"},"image":{"@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/#primaryimage"},"thumbnailUrl":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3.jpg","datePublished":"2025-03-01T12:00:00+00:00","dateModified":"2026-01-30T12:58:15+00:00","author":{"@id":"https:\/\/cehhs.utk.edu\/elps\/#\/schema\/person\/6bfd2c32cad7f6a411dfcf7e5dd65055"},"breadcrumb":{"@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/#primaryimage","url":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3.jpg","contentUrl":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3.jpg","width":2240,"height":1260},{"@type":"BreadcrumbList","@id":"https:\/\/cehhs.utk.edu\/elps\/is-your-data-dirty-the-importance-of-conducting-frequencies-first\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cehhs.utk.edu\/elps\/"},{"@type":"ListItem","position":2,"name":"Is Your Data Dirty? The Importance of Conducting Frequencies First"}]},{"@type":"WebSite","@id":"https:\/\/cehhs.utk.edu\/elps\/#website","url":"https:\/\/cehhs.utk.edu\/elps\/","name":"Educational Leadership and Policy Studies","description":"University of Tennessee, Knoxville","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cehhs.utk.edu\/elps\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/cehhs.utk.edu\/elps\/#\/schema\/person\/6bfd2c32cad7f6a411dfcf7e5dd65055","name":"Jonah Hall","url":"https:\/\/cehhs.utk.edu\/elps\/author\/jhall152\/"}]}},"featured_image_src":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3-600x400.jpg","featured_image_src_square":"https:\/\/cehhs.utk.edu\/elps\/wp-content\/uploads\/sites\/9\/2024\/07\/New-MAD-Blog-Design-Final-1-3-600x600.jpg","author_info":{"display_name":"Jonah Hall","author_link":"https:\/\/cehhs.utk.edu\/elps\/author\/jhall152\/"},"_links":{"self":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/posts\/23894","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/users\/86"}],"replies":[{"embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/comments?post=23894"}],"version-history":[{"count":0,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/posts\/23894\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/media\/23696"}],"wp:attachment":[{"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/media?parent=23894"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/categories?post=23894"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cehhs.utk.edu\/elps\/wp-json\/wp\/v2\/tags?post=23894"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}