0% found this document useful (0 votes)
35 views4 pages

Week 10 Tutorial Questions Chapter 6

Uploaded by

joehe2625
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
35 views4 pages

Week 10 Tutorial Questions Chapter 6

Uploaded by

joehe2625
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

CHAPTER 6

TRANSFORMING DATA

DISCUSSION QUESTIONS

1. Why is transforming data necessary and why does it take so much time? What
ways can you think of to reduce the time needed to transform data?

2. What are the strengths and weaknesses of each of the four data validation
procedures discussed in this chapter? What are other possible ways to validate
data?

Data Validation Strengths Weaknesses


Procedure
Visual Inspection
Basic Statistical Tests
Audit a Sample
Advanced Testing
Techniques

3. Match the following terms with the appropriate definition or example:

1 aggregate data a process of analyzing data to make certain the


data has the properties of high-quality data:
accuracy, completeness, consistency, timeliness,
and validity.
2 cryptic data values b data values that are correctly formatted but not
listed in the correct field.
3 data cleaning c all types of errors that come from inputting data
incorrectly.
4 data concatenation d examining data using human vision to see if there
are problems.
5 data consistency e the process of tracing extracted or transformed
values back to their original source.
6 data contradiction errors f data items that have no meaning without
understanding a coding scheme.
7 data de-duplication g the process of changing data into a common
format so that is useful for decision-making.
8 data entry errors h a technique that rotates data from a state of rows
to a state of columns.
9 data filtering i errors that occur when a secondary attribute in a
row of data does not match the primary
attribute.
10 data imputation j a data field that contains only two responses,
typically a 0 or 1. Also called a dichotomous
variable.
11 data parsing k the principle that every value in a field should be
stored in the same way.
12 data pivoting l the process of changing the organization and
relationships among data fields to prepare the
data for analysis.
13 data standardization m data errors that occur when a data value falls
outside an allowable level.
14 data structuring n a data field that contains only two responses,
typically a 0 or 1. Also called a dummy variable.
15 data threshold violations o the process of updating data to be consistent,
accurate and complete.
16 data validation p data that is inconsistent, inaccurate, or
incomplete.
17 dichotomous variable q separating data combined in a single field into
multiple fields.
18 dirty data r the combining of data from two or more fields
into a single field.
19 dummy variable s the process of replacing a null or missing value
with a substituted value.
20 misfielded data values t the process of removing records or fields of
information from a data source.
21 violated attribute u the process of analyzing data and removing two
dependencies or more records that contain identical
information.
22 visual inspection v the presentation of data in a summarized form.
W an error that exists when the same entity is
described in two conflicting ways.
X the process of ordering data to reveal unexpected
values.

4. Excel Project: Data Pivoting


You are a data analyst for the city of Burlington, Vermont. Download the data file
“[Link]” from the student download page at
[Link] which contains the annual account balance
information for city departments for six fiscal years. For this problem, use the sheet
titled “Annual Data”, which contains data aggregated to the annual level for the
different city departments.

REQUIRED
Using this data, prepare a different sheet that has a PivotTable that answers each of
the following questions:
a) How have total department budgets changed each year? To answer the question,
create a Pivot Table that shows the budgeted amount of expenditures for each
fiscal year. Do not include grand totals. Add conditional formatting data bars to
show which amounts are the greatest.
b) Which funds have the largest expense budgets for fiscal year 6? Create a
PivotTable that shows fund names and budgeted amounts for fiscal year 6. Sort
the data so the greatest budget amounts are listed at the top.
c) Regardless of department, organization, or fund, what type of activities were
most costly during the entire period (hint: use the “Detail Description” field for
this question)? How much did they pay for this activity?

5. Excel Project: Aggregating Data at Different Levels


You are an internal auditor for the city of Burlington, Vermont. Download the data
file “[Link]” from the student download page at
[Link] which contains all the annual account
balance information for city departments for six fiscal years. In this workbook are
two sheets. The “Annual Data” sheet contains data aggregated to the annual level
for the different city departments. The “Monthly Data” sheet contains data
aggregated to the monthly level for the different city departments. You are
planning to perform audit procedures on the “Monthly Data.” But before you do,
you need to verify that the data in this sheet matches the data in the “Annual Data”
worksheet, which you already verified is correct.

REQUIRED
Analyze the two sheets and, based on your analysis, answer the following questions:
a) Under what circumstances can you not use the “Annual Data” sheet for your
audit? Said differently, why might you need the data in the “Monthly Data”
sheet?
b) On a separate worksheet in Excel, create a summary of the data that shows the
total dollar amount of transactions for the two different sheets. Are these the
same for both data sets?
c) Does the total amount for transactions differ for the different departments and
years? Create two sheets: the first sheet should compare departments and the
second sheet should compare years. What do you learn from these analyses?
d) Based on your analysis of the previous questions, suggest the areas that you
believe are most important to investigate further. Why do you believe these
areas are the most important to investigate further?

6. For the S&S Case discussed in this chapter, you receive the following output
containing basic descriptive statistics for some of the columns in the full dataset
(the chapter example problem contained a small excerpt of data, this problem
uses more data). S&S has a total of 60 products that customers purchase across 3
categories.

REQUIRED
List the concerns you have with the data and discuss what steps you would take for
each concern you identified.

Common questions

Powered by AI

Data standardization ensures consistent data formatting, which is vital for reliable data analysis and decision-making. Without standardization, datasets may lack compatibility and coherence, leading to inefficiencies and inaccurate interpretations. Maintaining data standardization supports seamless integration and data sharing across departments, reducing redundancies and improving data quality. Organizations can achieve this by setting standard protocols, employing data governance frameworks, and using software tools designed for systematic standardization processes .

The 'Annual Data' sheet may not suffice for audits because it aggregates data at a high level, potentially obscuring monthly variations and anomalies. Detailed audits often require granular data to ensure accuracy and completeness, and to identify discrepancies or unusual patterns at a finer scale. Discrepancies between monthly and annual datasets should be addressed by cross-verifying totals and investigating time-specific anomalies. Reconciling these differences involves understanding transaction timings and their impact across different reporting levels .

Data pivoting, which rearranges data for analysis, allows users to aggregate and summarize complex datasets efficiently. Using Excel PivotTables, businesses can detect trends over time, such as how department budgets change annually, identify which funds have the largest expense budgets, and determine which activities incur the most costs over time. These tables also facilitate quick comparisons and reveal underlying patterns that inform strategic decisions, such as resource allocation and cost management by summarizing large datasets into digestible insights .

Visual inspection involves manually examining data for errors, offering a straightforward approach to spot glaring issues. However, its utility diminishes in large-scale environments due to human error risks and the time-intensive nature of the process. Despite its limitations, it's practical for initial scoping, training purposes, and small data manually checks. Utilizing software-enabled visual tools with user interfaces that leverage automated insights can expand its applicability in large-scale data environments, enabling efficient identification of data bugs without overwhelming manual efforts .

Visual inspection is a straightforward process useful for catching obvious errors by scanning data, but it's inefficient for large datasets. Basic statistical tests can highlight anomalies through metrics like means and medians; however, they may not detect nuanced errors. Auditing a sample (checking a representative sample of the data) is accurate but can be resource-intensive. Advanced testing techniques, like machine learning algorithms, can identify complex patterns and errors but require technical expertise. Additional methods could include real-time validation checks during data entry, using metadata for consistency checks, and implementing feedback loops in automated systems for continuous improvement .

Misfielded data values can cause analysis errors, reporting inaccuracies, and operational inefficiencies by placing data in incorrect fields, leading to misleading interpretations. Organizations can avoid these errors by implementing strong data validation rules at the entry stage, training personnel thoroughly, and employing automated tools to detect and correct such misplacements. Conducting regular reviews and implementing automated correction scripts are effective rectification measures .

Hierarchical data structures, which organize data into nested levels, enable complex data organizations that reflect real-world scenarios. Their manipulation during data transformation increases accuracy by maintaining relational integrity and reducing errors associated with hierarchical dependencies. Efficient manipulation requires advanced techniques like recursive queries or specialized software capable of handling multi-level hierarchies. Properly managing hierarchical data enhances analytics by facilitating sophisticated queries and aggregations, contributing to more informed decision-making processes .

Transforming data is often necessary because it ensures that data is converted into a format that is consistent and usable for analysis and decision-making. The process is time-consuming due to the need for thorough cleaning, integration, and adjustments to address inconsistencies and inaccuracies. Strategies to reduce time include automating parts of the transformation process using tools like ETL (Extract, Transform, Load) software, employing advanced algorithms for pattern recognition, and standardizing data at the point of entry to minimize errors .

Comparative analyses can highlight disparities in spending and resource allocation across departments and fiscal years. By comparing departments, one can assess which departments consistently exceed or stay under budget, potentially indicating efficiency or mismanagement. Yearly comparisons reveal trends or inconsistencies in financial practices or external factors affecting city expenditures. These insights can guide decisions on budget adjustments and identify areas for potential cost reduction or further investigation .

Data contradiction errors, where secondary attributes do not match primary attributes, can lead to misleading analytics and flawed decision-making. These errors undermine data integrity, causing mistrust and inefficiencies. Ensuring data consistency involves employing checks like cross-referencing databases, applying logic tests to detect contradictions, and enforcing strict data entry protocols. Regular audits and validation procedures, as well as employing automated tools to monitor data overlap and dependency violations, are crucial in maintaining consistent datasets .

You might also like