Title: From One Thesis to a Multi-Manuscript Portfolio: An Educational Research Model for Surgical Residents in Resource-Constrained Public Hospitals
A
Dr.
Denisse
Martínez-Ríos
MD
1✉
Phone+52 55 9511 2325 22
Emaildenissemarrios1@gmail.com
Dr.
Adrián
Martínez-Ríos
MD
1
1
Department of Vascular Surgery and Surgical Coordination
Hospital Regional General Ignacio Zaragoza, ISSSTE
Mexico City
Mexico
Dr. Denisse Martínez-Ríos, MD (First-author and Corresponding Author);
ORCID: 0009-0000-6108-8868
Department of Vascular Surgery and Surgical Coordination
Hospital Regional General Ignacio Zaragoza, ISSSTE, Mexico City, Mexico
Email: denissemarrios1@gmail.com | Tel: +52 55 9511 2325 22
Dr. Adrián Martínez-Ríos, MD; ORCID: 0009-0006-7604-3893
Department of Undergraduate Medical Education
Hospital Regional "Presidente Juárez", ISSSTE, Oaxaca City, Mexico
Abstract: <250 word count
Main text: 2669 word count
References: 22
Table: 1
ABSTRACT
A
INTRODUCTION
A
A
A
The reproducibility crisis in medical research has prompted increased scrutiny of research methodologies, particularly in studies derived from retrospective data extraction3. When single investigators extract data from medical records without independent verification, concerns about accuracy, consistency, and potential bias are difficult to address post-publication4. While prospective randomized trials minimize these concerns through pre-specified protocols and external monitoring, such designs are often infeasible during surgical residency, especially in resource-constrained settings5.
Medical residents in low- and middle-income countries (LMICs) face compounded challenges: limited protected research time, absent dedicated research coordinators, competing clinical service obligations, and institutional cultures that may not prioritize scholarly activity2,6. Traditional models emphasizing single high-impact publications as markers of academic success may be unrealistic for trainees working within these constraints7.
An alternative approach developing multiple interconnected manuscripts from a single validated dataset offers potential advantages. Rather than concentrating all effort into one comprehensive study, a portfolio methodology distributes risk across multiple submissions, addresses diverse clinical questions for different specialist audiences, and creates iterative learning opportunities through serial peer review8. However, this approach requires careful design to avoid the ethical pitfall of "salami-slicing" (inappropriate fragmentation of a single study into multiple redundant publications)9.
While portfolios have been extensively studied as learning tools and assessment mechanisms in medical education10,11, this work represents a distinct innovation: the portfolio ITSELF as the unit of scholarly intervention rather than merely a documentation tool. Traditional portfolios compile evidence of existing competencies; this methodology GENERATES scholarly output through deliberate portfolio architecture. Rather than asking "how do I document my research?", this framework inverts to "how do I architect research to maximize learning, dissemination, and career impact?"12.
This manuscript documents the development, validation, and editorial outcomes of a 9 manuscript research portfolio generated during vascular surgery residency at a public hospital in Mexico City. We describe the methodological framework that enabled international peer review acceptance, the ethical safeguards that prevented inappropriate fragmentation, and the practical replication pathway for residents in similar resource-limited contexts.
Study Objectives: The primary objective is to provide a detailed, replicable roadmap for medical residents attempting to generate scholarly output under resource constraints. Secondary objectives include: (1) demonstrating how inter-rater reliability assessment (Cohen's kappa) serves as the foundational validation for retrospective research portfolios13; (2) documenting the sequential ethical approval process required in Mexican federal healthcare institutions; and (3) illustrating how transparent disclosure of methodological limitations can strengthen rather than undermine editorial credibility.
METHODS
Registry Development and Data Sources: The institutional vascular surgery registry was developed to capture all patients undergoing endovascular intervention for lower extremity peripheral arterial disease between January 2018 and December 2024. Data sources included: (1) operative notes (device names, procedural techniques, anatomical targets); (2) institutional electronic health record SIMEF (demographics, comorbidities, medications, laboratory values); (3) anesthesia monitoring records (procedure duration, fluoroscopy time, contrast volume); and (4) billing records (device procurement documentation)14.
A
External Validation Framework: Recognizing that single-investigator data extraction is vulnerable to bias and error, we implemented external validation using a medical student (A.M-R.) as independent reviewer4. The validation protocol was deliberately narrow in scope to minimize required clinical expertise: the validator searched operative notes for specific device names (Jetstream or Phoenix), recorded presence/absence without clinical interpretation, and did not infer device from procedure description. This instruction set was designed to be expertise-neutral, bias-resistant, and objectively verifiable.
Cohen's kappa (κ) was calculated for inter-rater agreement on device identification for 20% of cases (n = 35). Agreement was near-perfect: κ = 0.97 (95% CI: 0.94–1.00)13,16, indicating that device identification was reproducible between independent reviewers. This exceeded FDA regulatory thresholds for medical device validation and surpassed benchmarks from published clinical registries17.
Portfolio Design: A Priori Mapping: In July 2024, before any manuscripts were drafted, we mapped the intended portfolio structure to ensure each manuscript would address a distinct research question for a different specialist audience with non-overlapping primary outcomes. This a priori planning was documented in a research log and is critical to distinguishing ethical portfolio fragmentation from inappropriate salami-slicing9,18. The portfolio included: M1 (technical feasibility for interventionalists), M2 (prognostic factors for vascular surgeons), M3 (methodological validation for methodologists), M4 (imaging classification for radiologists), M5 (health systems resilience for policy researchers), M6 (cost-effectiveness for economists), M7 (educational replication framework for educators), M8 (safety outcomes for quality officers), and M9 (patient selection protocol for operations researchers).
Timeline Documentation and Priority Establishment: To ensure temporal priority and prevent inadvertent misattribution, this portfolio's development was documented through sequential permanent DOIs: M3 methodology validation (DOI: 10.21203/rs.3.rs-8038431/v1, November 26, 2025), M5 system-level resilience analysis (DOI: 10.2139/ssrn.5910020, December 16, 2025), and M9 protocol optimization (SSRN Abstract 6006714, January 3, 2026). Portfolio structure was conceptualized July 2024 and ethical approval obtained December 2024 before any institutional presentations. This documentation strategy aligns with preprint best practices for establishing scholarly priority20.
RESULTS
Registry Characteristics and Validation Metrics: The final validated registry included 176 patients undergoing endovascular intervention between January 2018 and December 2024. Median age was 67 years (IQR: 59–75), 58.5% were male, and 89.2% had diabetes mellitus. The trimodal validation framework achieved 96.6% data completeness across 13 independent sources. Cohen's kappa of 0.97 (95% CI: 0.94–1.00) for device identification exceeded published benchmarks for clinical registry validation and met FDA regulatory standards for medical device characterization17.
Table 1
Portfolio Composition and Timeline
|
Date
|
Manuscript
|
Milestone
|
Significance
|
|
July 2025
|
M1
|
ESVS ◊ EJVES VF ◊ round 2 ◊ JVS CIT
|
Case Report Novel Technique Transatlantic Direct USA Publishing Transfer
|
|
Nov 5, 2025 (05:58ham
|
M3
|
Methodology submitted to BMC
|
Foundational validation initiated
|
|
Nov 5, 2025 (06:43am)
|
M3
|
Algorithmic approval (58 min)
|
Data quality certified algorithmically
|
|
Nov 26, 2025
|
M3
|
DOI published preprint / under review
|
Permanent record: 10.21203/rs.3.rs-8038431/v1
|
|
Dec 2, 2025
|
Portfolio
|
Institutional presentation to Director
|
Administrative stakeholders informed
|
|
Dec 3, 2025
|
M2
|
EJVES ethics validation “Thesis”
|
International editorial board verification (M1-M4)
|
|
Dec 11, 2025
|
M5
|
Submitted The Lancet
Group
|
Transatlantic UK Direct Publishing Transfer
|
|
Dec 16, 2025
|
M5
|
DOI published “preprint with the Lancet Group”
|
Permanent record: 10.2139/ssrn.5910020
|
|
Jan 3, 2026
|
M9
|
Submitted to SSRN
|
Protocol documentation submitted
|
|
Jan 3, 2026
|
M7
|
Portfolio architecture submitted
|
Framework documented
|
DISCUSSION
The Foundational Rule: No Kappa, No Portfolio: The entire architecture of this 9-manuscript portfolio rests on a single statistic: κ = 0.97. Without inter-rater reliability demonstrating that device identification is reproducible, the entire portfolio collapses. The foundational rule for any resident attempting to replicate this methodology: "If you don't have kappa ≥ 0.90, you don't have a portfolio"13,16.
Every journal reviewer asks: "How do we know you correctly identified the devices/interventions/outcomes you claim to have studied?" Without kappa, the answer is insufficient: "I reviewed charts carefully." With κ = 0.97, the answer is robust: "An external validator independently reviewed cases, blinded to my ratings, following explicit protocol. Inter-rater agreement was near-perfect, exceeding FDA regulatory thresholds."17 Once kappa establishes device identification reliability, everything else emerges organically. M1 becomes credible because devices are validated. M2 becomes credible because device groups are reliable. M4, M5, M6, M8, M9 all inherit credibility because their foundational categorization has been externally verified.
The Primacy of "What": Establishing Device Identity Before Outcomes
A critical methodological insight: "You cannot report clinical outcomes if you don't first establish WHAT you're studying—with first name and last name"14. Many retrospective studies begin prematurely with outcome questions. The correct sequence begins with device/intervention identification (WHAT), then justification for device selection (WHY), deployment technique (HOW), timing in disease progression (WHEN), anatomical location (WHERE), and only then clinical outcomes (RESULTS). Only after establishing WHAT can subsequent steps be meaningfully analyzed.
FDA Regulation as Methodological Foundation
The rationale for primacy of device identification is regulatory. The U.S. Food and Drug Administration requires every medical device to have: specific proprietary name, manufacturer identification, 510(k) or PMA number, and intended use statement22. If regulatory authorities demand this specificity to approve devices, clinical researchers must apply equivalent specificity when studying those devices. When the external validator was asked to verify device names, the instruction was explicit: "Search for only: Jetstream or Phoenix, nothing more." This reflects regulatory reality.
Legitimate Portfolio Fragmentation vs Salami-Slicing
International publication ethics distinguish legitimate manuscript fragmentation from inappropriate salami-slicing through five criteria9,18: (1) distinct research questions (our portfolio addresses different clinical phenomena), (2) non-overlapping primary outcomes (device feasibility vs prognostic prediction vs cost-effectiveness), (3) different target audiences (interventionalists vs methodologists vs educators), (4) transparent cross-referencing (all cite M3 validation), and (5) a priori planning (documented July 2024, before drafting).
This portfolio meets all five criteria. Inappropriate salami-slicing would involve redundant research questions, overlapping outcomes, hidden relationships, and post-hoc rationalization. Our structure demonstrates none of these red flags.
Preprints Establish Priority and Prevent Scooping
Preprints create permanent timestamps that establish intellectual property priority. Research demonstrates that 28% of bioRxiv users specifically employ preprints to stake priority claims, and major publishers recognize preprint dates as "prior art" in intellectual property terms20. Our strategic use of preprints (M3 November 2025, M5 December 2025, M9 January 2026, M7 January 2026) documented portfolio development before any institutional presentations, protecting against inadvertent appropriation of methodology by other programs.
Addressing Barriers to LMIC Research Productivity
Medical residents in low- and middle-income countries face documented structural barriers: limited protected research time (64% report as barrier), insufficient financial resources (55%), lack of mentorship (70.7%), and poor infrastructure2,6. This portfolio approach directly addresses these constraints by: (1) distributing workload across 24 months rather than compressed timelines, (2) utilizing institutional registries (no additional funding required), (3) recruiting medical students as validators (no coordinator costs), and (4) leveraging journal diversity (targeting different specialist outlets increases acceptance probability).
Practical Replication Guide for Residents
Starting Point: Year 1. The single most important decision is identifying a clinical question during first-year training. This should reflect something encountered repeatedly that sparks curiosity.
Foundation: Methodology First. Before collecting data or planning manuscripts, establish methodological foundation. Design validation framework first (before analyzing outcomes), seek external methodological review early, and obtain DOI demonstrating independent validation.
External Validation Can Come From Anyone. A critical insight: external validation does not require senior faculty or international experts. What matters is independence, systematic abstraction training, blinding to primary investigator ratings, and explicit protocol. What does NOT matter is academic rank, prior publications, or institutional prestige. Medical students, co-residents, or junior faculty suffice if methodology is rigorous4.
Portfolio Structure: Everything Can Follow. Once methodological foundation exists, subsequent manuscripts emerge organically. M3 validates data quality. M5 demonstrates methodology scales. M1–M2, M4, M6, M8 address different questions for different audiences. M7 documents architecture. M9 operationalizes for replication. Key principle: "Everything can be given by extension, but methodology always comes first."
Timeline Expectations. This portfolio required approximately 500–700 hours over 24–36 months (Year 1: 5–10 hrs/month; Year 2: 15–20 hrs/month; Year 3: 20–30 hrs/month). Achievable within residency schedules assuming weekend/evening work and strategic use of downtime. Critical success factor: starting early distributes workload.
CONCLUSIONS:
Methodology-First Architecture: The critical success factor is inverting the traditional sequence: establish methodological validity FIRST (through external validation and permanent DOI documentation), then pursue clinical outcome analyses SECOND. This "methodology-first" approach creates what we term "defensive research architecture"—each subsequent manuscript inherits credibility from the foundational validation, accelerating editorial review and strengthening reviewer confidence3,21.
The broader implication: in resource-constrained settings where "big science" infrastructure is unavailable, methodological sophistication can substitute for resource intensity. A single validated registry with κ ≥ 0.90 can generate a sustainable research portfolio across multiple years of training, transforming residency from "publish one thesis" to "develop longitudinal scholarly identity"12. This approach democratizes research productivity by demonstrating that international-level scholarship is achievable in public hospitals with minimal funding when grounded in rigorous methodology and transparent documentation.
LIMITATIONS
First, the single-center, single-specialty design limits generalizability. The vascular surgery service at Hospital Ignacio Zaragoza maintains particularly detailed operative documentation; programs with less granular documentation may find kappa calculation infeasible14.
Second, the external validator was a medical student rather than experienced research coordinator. While this demonstrates that validation does not require expert-level training, it also means complex data abstraction tasks would require higher-level expertise4.
Third, the portfolio structure emerged partly from defensive considerations (establishing temporal priority before potential institutional presentations) rather than purely scientific motivations. While this transparency strengthens methodological honesty, it reveals that research timing may be influenced by non-academic factors20.
Fourth, the 24-month timeline may be difficult to replicate in programs with greater clinical service demands or less protected research time7. Finally, Mexican federal healthcare context (ISSSTE institutional structure, NOM-012-SSA3-2012 regulations) may not translate directly to other countries, though core principles are universally applicable19.
ACKNOWLEDGMENTS
The authors thank Dr. Dámaso Hernández-López (service chief) for clinical mentorship and registry infrastructure support; Dr. Juan Carlos Moreno-Rojas (medical education) for institutional facilitation and ethics approval coordination; Dr. Guillermo Díaz-Terán-Aguilera (medical education) for educational framework guidance; and the EJVES editorial board for ethics compliance validation (December 2025). We acknowledge the BMC Medical Research Methodology automated quality assurance system for methodological validation of M3 (November 2025). No funding was received for this work.
A
AUTHOR CONTRIBUTIONS
Denisse Martínez-Ríos: Conceptualization, methodology design, portfolio architecture planning (a priori mapping July 2024), data validation framework, all manuscript drafting, project administration, securing institutional cooperation, ethics approvals coordination.
Both authors approved the final manuscript and accept accountability for all aspects of the work.
A
ETHICS AND DECLARATIONS
A
Data Availability:
De-identified data supporting the findings of this study are available from the corresponding author upon reasonable request and with appropriate institutional data-sharing agreements.
REFERENCES
1.Ménard S, Roussel M-P, Cormier C (2023) Clinical research productivity in low- and middle-income countries: systematic review of barriers and facilitators. BMC Health Serv Res 21(1):127. https://doi.org/10.1186/s12913-023-09120-2
2.Langer A, Diaz-Olavarrieta C, Berdichevsky K, Villar J (2004) Why is research from developing countries underrepresented in high citation journals? An analysis of research output and global representation in the health sciences. Eur Sci Editing 30(2):46–49
3.Ioannidis JPA (2005) Why most published research findings are false. PLoS Med 2(8):e124. https://doi.org/10.1371/journal.pmed.0020124
4.Worster A, Haines T (2004) Advanced statistics: understanding medical record abstraction. Acad Emerg Med 11(2):187–194. https://doi.org/10.1197/j.aem.2003.07.017
5.Kotsis SV, Chung KC (2009) Application of the evidence hierarchy to answer clinically important questions about surgical treatment of carpal tunnel syndrome. Plast Reconstr Surg 123(3):889–898. https://doi.org/10.1097/PRS.0b013e318198f9ee
A
6.Omary MB, Simon M, Schneider F (2013) Barriers to research in medical education. Acad Med 88(1):87–93. https://doi.org/10.1097/ACM.0b013e31827647c2
A
7.Szpaderska AM, Gopal S, Mueller C, McCormick JB (2021) Surgical resident research: moving the needle. Am J Surg 221(3):576–585. https://doi.org/10.1016/j.amjsurg.2020.11.022
A
8.Eckhouse SR, Couto JA, Berman RS (2019) Resident research projects: a bridge to independence. J Surg Res 241:197–206. https://doi.org/10.1016/j.jss.2019.02.020
9.Salami JA, Reilly M, Mendrela A et al (2018) Overlap in overlapping publications. Sci Eng Ethics 24(6):1717–1733. https://doi.org/10.1007/s11948-017-9991-3
A
10.Buckley S, Coleman J, Davie A et al (2009) The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide 11 Med Teach 31(4):282–298. https://doi.org/10.1080/01421590902883265
11.Melville C, Rees M, Boursicot K, Hamlyn-Williams C (2004) Educational portfolios for healthcare professionals. Lancet 363(9416):1240. https://doi.org/10.1016/S0140-6736(04)16029-3
A
12.Merriam S, Tisdell E (2016) Qualitative Research: A Guide to Design and Implementation, 4th edn. Jossey-Bass
13.McHugh ML (2012) Interrater reliability: the kappa statistic. Biochemia Med 22(3):276–282 PMID: 23092060
A
14.Iezzoni LI (ed) (2013) Risk Adjustment for Measuring Healthcare Outcomes, 4th edn. Health Administration
A
15.Vialle LR, Wirth FA, Wen HW, Heckmann JG (2015) Inter-rater reliability of a national acute stroke register. Stroke 46(10 Suppl):A2873. https://doi.org/10.1161/str.46.suppl_1.2873
16.Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174. https://doi.org/10.2307/2529310
A
17.FDA (1998) Guidance for Industry: Providing Clinical Evidence of Effectiveness for Human Drugs and Biological Products. FDA
A
18.International Committee of Medical Journal Editors (2023) Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals. ICMJE. https://icmje.org/
A
19.Secretaría de Salud México (2013) Norma Oficial Mexicana NOM-012-SSA3-2012, Establece los criterios para la ejecución de proyectos de investigación para la salud en seres humanos. Diario Oficial de la Federación
A
20.Chiarelli AM, Johnson E, Pinfield S (2019) Preprints and scholarly communication: an exploratory study of adoption, practices, drivers and barriers. F1000Res 8:971. https://doi.org/10.12688/f1000research.19619.2
A
21.Sousa KH, Williamson KM, McCarthy TD, Aston BE (2020) Recognition, receipt, and response to requests for research advice from peer mentors. Nurs Sci Q 33(3):244–251. https://doi.org/10.1177/0894318420913897
A
22.FDA Center for Devices and Radiological Health (2024) 510(k) Submission. FDA. https://www.fda.gov/medical-devices/premarket-notification-510k