See discussions, stats, and author profiles for this publication at: [Link]

net/publication/387060030

The Implications of Citation Errors

Article in Bulletin of the Academy · December 2024

CITATIONS READS
0 53

2 authors, including:

Daba Debo

156 PUBLICATIONS 149 CITATIONS

SEE PROFILE

All content following this page was uploaded by Daba Debo on 14 December 2024.

The user has requested enhancement of the downloaded file.

 The Implications of Citation Errors

Alan Damam

Calven University

12, December 2024

Introduction

Citations are a cornerstone of scholarly communication, serving both as a reward system for researchers
and as a tool for constructing arguments and establishing the intellectual foundation of research. Proper
citation practices enable researchers to build upon existing knowledge, identify gaps, and integrate new
findings into the broader scientific narrative. However, as the text highlights, the integrity of citations is
often compromised by errors and misuse, leading to several challenges that affect both research quality
and its assessment.

Citations perform dual roles in research: epistemic and evaluative. From an epistemic perspective, they
situate a study within the existing body of knowledge, framing research questions, justifying
methodologies, and contextualizing results. Evaluatively, they serve as metrics for academic impact,
influencing funding decisions, career advancements, and institutional rankings. However, the efficacy of
citations in fulfilling these roles depends on their proper application and interpretation.

Citation Errors and Their Implications

Citations play a crucial role in scientific research, serving as both a reward system and a rhetorical tool.
Proper citation is essential for identifying knowledge gaps, explaining results, and establishing the
current state of understanding in a field. However, citation errors are common, with up to 80% of
authors not fully reading the papers they cite, potentially perpetuating misinformation. Various citation
styles exist, including Vancouver, Harvard, and APA, which authors must follow consistently. While
some argue for the use of "simple and objective" citation statistics in research assessment, this approach
can be misleading and should not replace peer review. To improve citation practices, researchers should
adopt specific rhetorical strategies, such as using citations in introductions and combining author names

1
with placement to indicate centrality in scientific discourse. Ultimately, proper citation is crucial for
maintaining research integrity and advancing scientific knowledge.

Challenges in Citation Analysis

Citation analysis, while valuable for tracking intellectual development and information retrieval, faces
several challenges. "Problematic citations" can perpetuate outdated concepts, as seen in the case of
folinic acid rescue after high-dose methotrexate treatment. Issues include citing irrelevant data,
misrepresenting statistical significance, and selective data presentation. The accuracy of citation analysis
is further compromised by problems such as informal citations and biased coverage of the literature. To
address the growing volume of public comments in e-rulemaking, machine learning techniques have
been applied to recognize citation sentences, with some success in detecting references to external
sources of information. However, citation systems often provide limited information about authors and
publications, leading to potential confusion and misattribution. This inadequacy in author identification
can result in erroneous attribution of works across disparate fields and time periods.

Research on citation impact reveals diverse perspectives. Advanced driver assistance systems in vehicles
may reduce traffic citations, potentially impacting local government revenues. Conversely, a study in
Quebec found that a significant reduction in traffic citations led to an increase in collisions with injuries,
highlighting the importance of enforcement in road safety. In the legal domain, the citation of Wikipedia
in judicial opinions raises concerns about the reliability and permanence of information sources.
Meanwhile, sentiment analysis of citations offers a more nuanced approach to measuring scientific
impact, as not all citations are positive. A study found that ranking publications based on sentiment
scores of citations yielded higher accuracy compared to raw citation counts, suggesting that positive
opinions correlate with higher relevance. These findings underscore the complexity of citation impact
across different fields.

Citation analysis offers insights into intellectual development and research impact but is fraught with
limitations. Issues such as informal citations, biased literature coverage, and inadequate author
identification undermine the accuracy of such analyses. Informal citations, for instance, may lack the
rigor needed to support claims, while biased coverage disproportionately favors well-known or Western
sources, marginalizing other valuable contributions.

Moreover, the simplistic reliance on citation counts as indicators of impact is problematic. Citations can
reflect positive acknowledgment, neutral reference, or negative critique. For example, a highly cited
article may owe its visibility to controversy rather than scholarly merit. Addressing this limitation

2
requires nuanced approaches like sentiment analysis, which evaluates the tone of citations to discern
their qualitative impact.

Sentiment Analysis: A Refined Measure of Impact

The potential impact of autonomous vehicles (AVs) on traffic citation revenues has been widely
discussed. While not many vehicles in the US meet the requirements to be truly autonomous, a vast
majority of newer vehicles contain several advanced driver assistance systems (ADASs). Many of these
ADASs can improve both driver behavior and safety. Thus, these ADASs can affect traffic citations and
the local/state revenues. In this study, we qualitatively identify ADASs that have potential to impact
citations, and we qualitatively identify citations that have the most potential to be reduced by the
introduction of various ADASs. We concluded that many of the ADASs that currently exist can prevent
or reduce the frequency of common citation types. While a reduction in citations might sound attractive
to many individuals, a reduction in revenue largely impacts local and state governments and can
ultimately affect these individuals.

The use of sentiment analysis, as described in the text, represents a significant advancement in citation
evaluation. By categorizing citations as positive, neutral, or negative, sentiment analysis provides a more
granular understanding of research impact. The results, where sentiment-based rankings outperform raw
citation counts in precision (e.g., SRC of 0.7397 vs. 0.6728), underscore its potential to improve
research evaluation frameworks. This approach aligns with broader efforts to contextualize metrics,
ensuring they reflect the quality and relevance of research rather than sheer volume.

Citations in Non-Academic Contexts

Wikipedia has been cited in over four hundred American judicial opinions. Courts have taken judicial
notice of Wikipedia content, based their reasoning on Wikipedia entries, and decided dispositive
motions on the basis of Wikipedia content. The impermanent nature of Wikipedia entries and their
questionable quality raises a number of unique concerns. To date, no law review article has
comprehensively examined the citation of Wikipedia in judicial opinions or considered its long-range
implications for American [Link] article reports the results of an exhaustive study examining every
American judicial opinion that cites a Wikipedia entry. The article begins with a discussion of cases that
cite Wikipedia for a significant aspect of the case before the court. The impact of these citations on
litigants’ constitutional and procedural rights, the law of evidence, judicial ethics, and the judicial role in
the common law adversarial system are explored. Part II discusses collateral references to Wikipedia
entries. Part III proposes a set of best practices for when and how Wikipedia should be cited. Detailed
statistics on the quality of Wikipedia entries cited in judicial opinions and the completeness and

3
accuracy of citations to Wikipedia entries are provided. The article concludes with a discussion of the
impact of Wikipedia citations in judicial opinions on the future of the law.

Beyond academia, citations influence areas such as public policy, legal systems, and even local
governance. The discussion of Wikipedia's role in judicial opinions highlights the risks of relying on
mutable and potentially unreliable sources. Courts referencing Wikipedia for dispositive motions or
constitutional decisions raises ethical and procedural concerns, given the platform’s impermanence and
variable quality. The proposed best practices for judicial citation of Wikipedia underscore the necessity
of balancing accessibility with reliability in legal reasoning.

Similarly, the examination of traffic citations in the context of autonomous vehicles (AVs) illustrates the
interdisciplinary reach of citation studies. Advanced driver assistance systems (ADASs) may reduce
traffic violations, thereby impacting local and state revenues. This finding has significant implications
for governance, highlighting the unintended financial consequences of technological advancements.

Broader Implications for Research Integrity

The impact of a publication is often measured by the number of citations it received, this number being
taken as a proxy for the relevance of published work. However, a higher citation index does not
necessarily mean that a publication necessarily had a positive feedback from citing authors, as a citation
can represent a negative criticism. In order to overcome this limitation, we used sentiment analysis to
rate citations as positive, neutral or negative. Adjectives are initially extracted from the citations, with
the Senti WordNet lexicon being used to rate the degree of positivity and negativity for each adjective.
Relevance scores were then computed to rank citations according to the sentiment expressed in the text
corresponding to each citation. As expected for accurate information retrieval systems, higher precision
rates were observed in the initial points of the curve. The SRC (0.6728) computed using number of raw
citations is lower than the SRC (0.7397) observed by the ranking generated using sentiment scores
(Table 3). Conclusion: This result indicates that child articles with higher values of relevance score were
in general the ones expressing positive opinion about their parents. Therefore, the ranking generated by
sentiment scores had an improved accuracy.

Proper citation practices are essential for maintaining research integrity and advancing scientific
knowledge. The text's discussion of rhetorical strategies, such as emphasizing centrality through the
placement of author names, reflects the nuanced ways citations shape scientific discourse. Moreover, the
adoption of machine learning techniques for identifying citation sentences in public comments
demonstrates the growing intersection of technology and citation analysis.

4
 However, the challenges outlined—ranging from citation errors and biased metrics to the misuse of
platforms like Wikipedia—underscore the need for systemic improvements. Recommendations include:

1. Promoting Critical Engagement: Researchers should be encouraged to thoroughly engage with

cited works, ensuring accurate representation of their content.
2. Integrating Advanced Metrics: Tools like sentiment analysis should complement traditional
citation counts, offering a balanced view of research impact.
3. Enhancing Author Identification Systems: Efforts to improve metadata and disambiguate
authorship can reduce errors and misattributions.
4. Establishing Cross-Disciplinary Standards: Harmonizing citation practices across disciplines
can enhance consistency and reduce confusion.

Conclusion

Citations are not merely references; they are dynamic tools that shape the trajectory of knowledge and
policy. As research becomes increasingly interdisciplinary and technology-driven, the complexities of
citation practices and their implications demand careful attention. Addressing the challenges outlined in
the text requires a combination of methodological rigor, technological innovation, and ethical
commitment. By fostering better citation practices and leveraging advanced analytical tools, the
scientific community can uphold the integrity of research and its contributions to society.

References;

Blais, E., & Gagné, M. (2010). The effect on collisions with injuries of a reduction in traffic citations
issued by police officers. Injury Prevention, 16, 393 - 397.

Cavalcanti, D.C., Prudêncio, R.B., Pradhan, S.S., Shah, J., & Pietrobon, R. (2011). Good to be Bad?
Distinguishing between Positive and Negative Citations in Scientific Impact. 2011 IEEE 23rd
International Conference on Tools with Artificial Intelligence, 156-162.

Cavalcanti, D.C., Prudêncio, R.B., Pradhan, S.S., Shah, J., & Pietrobon, R. (2011). Good to be Bad?
Distinguishing between Positive and Negative Citations in Scientific Impact. 2011 IEEE 23rd
International Conference on Tools with Artificial Intelligence, 156-162.

Penmetsa, P., Dhondia, S., Poptic, S., Hudnall, M., Parrish, A., & Nambisan, S. (2023). Impacts on
Traffic Citations by Advanced Driver Assistance Systems. International Conference on Transportation
and Development 2023.

Saaida, M. (2024). Canned citations in scientific research. Temple Law Review, 5(2), 1-12.

View publication stats