scholar-evaluation

Name: scholar-evaluation
Author: LeonChaoX

698stars61forks

How to install scholar-evaluation?

leonchaox/qinyan-academic-skills/scholar-evaluation

$npx -y skills add LeonChaoX/qinyan-academic-skills --skill scholar-evaluation

Installs into the current project.

Summary

Systematically evaluate scholarly work using the ScholarEval framework, providing structured assessment across research quality dimensions including problem formulation, methodology, analysis, and writing with quantitative scoring and actionable feedback.

Files · 1

View on GitHub

SKILL.md

1	# Scholar Evaluation
2
3	## Overview
4
5	Apply the ScholarEval framework to systematically evaluate scholarly and research work. This skill provides structured evaluation methodology based on peer-reviewed research assessment criteria, enabling comprehensive analysis of academic papers, research proposals, literature reviews, and scholarly writing across multiple quality dimensions.
6
7	## When to Use This Skill
8
9	Use this skill when:
10	- Evaluating research papers for quality and rigor
11	- Assessing literature review comprehensiveness and quality
12	- Reviewing research methodology design
13	- Scoring data analysis approaches
14	- Evaluating scholarly writing and presentation
15	- Providing structured feedback on academic work
16	- Benchmarking research quality against established criteria
17	- Assessing publication readiness for target venues
18	- Providing quantitative evaluation to complement qualitative peer review
19
20	## Visual Enhancement with Scientific Schematics
21
22	When creating documents with this skill, always consider adding scientific diagrams and schematics to enhance visual communication.
23
24	If your document does not already contain schematics or diagrams:
25	- Use the scientific-schematics skill to generate AI-powered publication-quality diagrams
26	- Simply describe your desired diagram in natural language
27	- Nano Banana Pro will automatically generate, review, and refine the schematic
28
29	For new documents: Scientific schematics should be generated by default to visually represent key concepts, workflows, architectures, or relationships described in the text.
30
31	How to generate schematics:
32	```bash
33	python scripts/generate_schematic.py "your diagram description" -o figures/output.png
34	```
35
36	The AI will automatically:
37	- Create publication-quality images with proper formatting
38	- Review and refine through multiple iterations
39	- Ensure accessibility (colorblind-friendly, high contrast)
40	- Save outputs in the figures/ directory
41
42	When to add schematics:
43	- Evaluation framework diagrams
44	- Quality assessment criteria decision trees
45	- Scholarly workflow visualizations
46	- Assessment methodology flowcharts
47	- Scoring rubric visualizations
48	- Evaluation process diagrams
49	- Any complex concept that benefits from visualization
50
51	For detailed guidance on creating schematics, refer to the scientific-schematics skill documentation.
52
53	---
54
55	## Evaluation Workflow
56
57	### Step 1: Initial Assessment and Scope Definition
58
59	Begin by identifying the type of scholarly work being evaluated and the evaluation scope:
60
61	Work Types:
62	- Full research paper (empirical, theoretical, or review)
63	- Research proposal or protocol
64	- Literature review (systematic, narrative, or scoping)
65	- Thesis or dissertation chapter
66	- Conference abstract or short paper
67
68	Evaluation Scope:
69	- Comprehensive (all dimensions)
70	- Targeted (specific aspects like methodology or writing)
71	- Comparative (benchmarking against other work)
72
73	Ask the user to clarify if the scope is ambiguous.
74
75	### Step 2: Dimension-Based Evaluation
76
77	Systematically evaluate the work across the ScholarEval dimensions. For each applicable dimension, assess quality, identify strengths and weaknesses, and provide scores where appropriate.
78
79	Refer to `references/evaluation_framework.md` for detailed criteria and rubrics for each dimension.
80
81	Core Evaluation Dimensions:
82
83	1. Problem Formulation & Research Questions
84	- Clarity and specificity of research questions
85	- Theoretical or practical significance
86	- Feasibility and scope appropriateness
87	- Novelty and contribution potential
88
89	2. Literature Review
90	- Comprehensiveness of coverage
91	- Critical synthesis vs. mere summarization
92	- Identification of research gaps
93	- Currency and relevance of sources
94	- Proper contextualization
95
96	3. Methodology & Research Design
97	- Appropriateness for research questions
98	- Rigor and validity
99	- Reproducibility and transparency
100	- Ethical considerations
101	- Limitations acknowledgment
102
103	4. Data Collection & Sources
104	- Quality and appropriateness of data
105	- Sample size and representativeness
106	- Data collection procedures
107	- Source credibility and reliability
108
109	5. Analysis & Interpretation
110	- Appropriateness of analytical methods
111	- Rigor of analysis
112	- Logical coherence
113	- Alternative explanations considered
114	- Results-claims alignment
115
116	6. Results & Findings
117	- Clarity of presentation
118	- Statistical or qualitative rigor
119	- Visualization quality
120	- Interpretation accuracy
121	- Implications discussion
122
123	7. Scholarly Writing & Presentation
124	- Clarity and organization
125	- Academic tone and style
126	- Grammar and m

People who liked this also viewed

6 picks

Type

scholar-evaluation

698stars61forks

View on GitHub

How to install scholar-evaluation?

leonchaox/qinyan-academic-skills/scholar-evaluation

$npx -y skills add LeonChaoX/qinyan-academic-skills --skill scholar-evaluation

Installs into the current project.

Summary

Files · 1

View on GitHub

SKILL.md

1	# Scholar Evaluation
2
3	## Overview
4
5	Apply the ScholarEval framework to systematically evaluate scholarly and research work. This skill provides structured evaluation methodology based on peer-reviewed research assessment criteria, enabling comprehensive analysis of academic papers, research proposals, literature reviews, and scholarly writing across multiple quality dimensions.
6
7	## When to Use This Skill
8
9	Use this skill when:
10	- Evaluating research papers for quality and rigor
11	- Assessing literature review comprehensiveness and quality
12	- Reviewing research methodology design
13	- Scoring data analysis approaches
14	- Evaluating scholarly writing and presentation
15	- Providing structured feedback on academic work
16	- Benchmarking research quality against established criteria
17	- Assessing publication readiness for target venues
18	- Providing quantitative evaluation to complement qualitative peer review
19
20	## Visual Enhancement with Scientific Schematics
21
22	When creating documents with this skill, always consider adding scientific diagrams and schematics to enhance visual communication.
23
24	If your document does not already contain schematics or diagrams:
25	- Use the scientific-schematics skill to generate AI-powered publication-quality diagrams
26	- Simply describe your desired diagram in natural language
27	- Nano Banana Pro will automatically generate, review, and refine the schematic
28
29	For new documents: Scientific schematics should be generated by default to visually represent key concepts, workflows, architectures, or relationships described in the text.
30
31	How to generate schematics:
32	```bash
33	python scripts/generate_schematic.py "your diagram description" -o figures/output.png
34	```
35
36	The AI will automatically:
37	- Create publication-quality images with proper formatting
38	- Review and refine through multiple iterations
39	- Ensure accessibility (colorblind-friendly, high contrast)
40	- Save outputs in the figures/ directory
41
42	When to add schematics:
43	- Evaluation framework diagrams
44	- Quality assessment criteria decision trees
45	- Scholarly workflow visualizations
46	- Assessment methodology flowcharts
47	- Scoring rubric visualizations
48	- Evaluation process diagrams
49	- Any complex concept that benefits from visualization
50
51	For detailed guidance on creating schematics, refer to the scientific-schematics skill documentation.
52
53	---
54
55	## Evaluation Workflow
56
57	### Step 1: Initial Assessment and Scope Definition
58
59	Begin by identifying the type of scholarly work being evaluated and the evaluation scope:
60
61	Work Types:
62	- Full research paper (empirical, theoretical, or review)
63	- Research proposal or protocol
64	- Literature review (systematic, narrative, or scoping)
65	- Thesis or dissertation chapter
66	- Conference abstract or short paper
67
68	Evaluation Scope:
69	- Comprehensive (all dimensions)
70	- Targeted (specific aspects like methodology or writing)
71	- Comparative (benchmarking against other work)
72
73	Ask the user to clarify if the scope is ambiguous.
74
75	### Step 2: Dimension-Based Evaluation
76
77	Systematically evaluate the work across the ScholarEval dimensions. For each applicable dimension, assess quality, identify strengths and weaknesses, and provide scores where appropriate.
78
79	Refer to `references/evaluation_framework.md` for detailed criteria and rubrics for each dimension.
80
81	Core Evaluation Dimensions:
82
83	1. Problem Formulation & Research Questions
84	- Clarity and specificity of research questions
85	- Theoretical or practical significance
86	- Feasibility and scope appropriateness
87	- Novelty and contribution potential
88
89	2. Literature Review
90	- Comprehensiveness of coverage
91	- Critical synthesis vs. mere summarization
92	- Identification of research gaps
93	- Currency and relevance of sources
94	- Proper contextualization
95
96	3. Methodology & Research Design
97	- Appropriateness for research questions
98	- Rigor and validity
99	- Reproducibility and transparency
100	- Ethical considerations
101	- Limitations acknowledgment
102
103	4. Data Collection & Sources
104	- Quality and appropriateness of data
105	- Sample size and representativeness
106	- Data collection procedures
107	- Source credibility and reliability
108
109	5. Analysis & Interpretation
110	- Appropriateness of analytical methods
111	- Rigor of analysis
112	- Logical coherence
113	- Alternative explanations considered
114	- Results-claims alignment
115
116	6. Results & Findings
117	- Clarity of presentation
118	- Statistical or qualitative rigor
119	- Visualization quality
120	- Interpretation accuracy
121	- Implications discussion
122
123	7. Scholarly Writing & Presentation
124	- Clarity and organization
125	- Academic tone and style
126	- Grammar and m

People who liked this also viewed

6 picks

Type