Human-Computer Co-Creation

We design methods and tools for human-computer co-creation improving research and design processes and outcomes

 

Research Activities

 

Designing Assistants for Prototyping Graphical User Interfaces (GUIs)

Early involvement of users into software development has proven to be a success factor for many software development projects. Especially, generating ...

 

 

More...

 

Designing Citizen Science Systems

Scientific research typically involves some kind of research problem discovery activity in order to identify and understand the problem space. Researchers can ...

 

 

More...

 

 

AutoChemplete

Blind and low-vision students in STEM subjects need specially labeled PDF documents (U/A compliant), so that they can read them with ...

 

 

More...

 

 

 

Wir-Forschen.Digital: Digital Citizen Science Platform

Digital technologies allow different stakeholders to share information efficiently. This is particularly exciting for the domain of Citizen Science,...

 

 

More...

 

 

 

CrowdSurfer

Good design feedback on software requires the feedback provider to understand the context of use. To allow crowdworkers to be ...

 

 

More...

 

 

 

Designing Crowd-Feedback Systems

User involvement is of critical importance in the development of any information system (IS).  In the recent years, ...

 

 

More...

 

 

 

AI-based Systems for Qualitative Data Collection

One of the critical reasons for failed IS projects is the inability to accurately meet user requirements, resulting from an incomplete or inaccurate collection of requirements during the requirements elicitation (RE) phase...

 

 

More...

 

 

 

Interactive Chatbot Development Systems

User input is essential for the successful development of question-and-answer (QA) chatbots. Therefore, interactive development systems are emerging that allow developers to involve test-users in the QA chatbot development process...

 

 

More...

 

 

 

Design Science Research Process Support with MyDesignProcess

A rich body of knowledge on approaches, methods, and frameworks supports researchers in conducting research projects. While methodological guidance is abundant, there is little support and guidance for documenting and effectively managing research processes...

 

 

More...

 

 

Interested in our topics? Send us an email now and join our team as a student research assistant!

 

Publications


2024
HILL: A Hallucination Identifier for Large Language Models
Leiser, F.; Eckhardt, S.; Leuthe, V.; Knaeble, M.; Maedche, A.; Schwabe, G.; Sunyaev, A.
2024. CHI ’24: Proceedings of the CHI Conference on Human Factors in Computing Systems. Ed.: F. Mueller, Association for Computing Machinery (ACM). doi:10.1145/3613904.3642428
Human-Centered Crowd Feedback for Information Systems Development. PhD dissertation
Haug, S.
2024, February 1. Karlsruher Institut für Technologie (KIT). doi:10.5445/IR/1000167935
HILL: A Hallucination Identifier for Large Language Models
Leiser, F.; Eckhardt, S.; Leuthe, V.; Knaeble, M.; Maedche, A.; Schwabe, G.; Sunyaev, A.
2024. arxiv. doi:10.48550/arXiv.2403.06710
Paintings, Not Noise—The Role of Presentation Sequence in Labeling
Knäble, M.; Nadj, M.; Mädche, A.
2024. Interacting with Computers, Art.-Nr.: iwae008. doi:10.1093/iwc/iwae008
2023
The Human-in-the-loop CrowdSurfer Concept: Providing User-centered AI Support to Crowdworkers for Improved Working Conditions and Task Outcomes
Benke, I.; Haug, S.; Maedche, A.
2023. Proceedings UCAI ’23: Workshop on User-Centered Artificial Intelligence at Mensch und Computer 2023
Scalable Design Evaluation for Everyone! Designing Configuration Systems for Crowd-Feedback Request Generation
Haug, S.; Sommerrock, S.; Benke, I.; Mädche, A.
2023. Mensch und Computer 2023, 91–100, Association for Computing Machinery (ACM). doi:10.1145/3603555.3603566
From ChatGPT to FactGPT: A Participatory Design Study to Mitigate the Effects of Large Language Model Hallucinations on Users
Leiser, F.; Eckhardt, S.; Knaeble, M.; Mädche, A.; Schwabe, G.; Sunyaev, A.
2023. Mensch und Computer 2023, 81–90, Association for Computing Machinery (ACM)
"Garbage In, Garbage Out”: Mitigating Human Biases in Data Entry by Means of Artificial Intelligence
Eckhardt, S.; Knaeble, M.; Bucher, A.; Staehelin, D.; Dolata, M.; Agotai, D.; Schwabe, G.
2023. J. Abdelnour Nocera (Ed.), Human-Computer Interaction – INTERACT 2023 – 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part III. Ed.: J. Abdelnour Nocera, 27 – 48, Springer Nature Switzerland. doi:10.1007/978-3-031-42286-7_2
A Mimetic Theory of User Behaviors in Online Communities: A Computational Study of GitHub
Grisold, T.; Gau, M.; Yoo, Y.
2023, August 4. 83rd Annual Meeting of the Academy of Management (2023), Squantum, MA, USA, August 4–8, 2023
Accessing the Design Science Knowledge Base - A Search Engine for the Accumulation of Knowledge Across Decentrally Organized Publications
Gau, M.; Mädche, A.; Brocke, J.
2023. Design Science Research for a New Society: Society 5.0, Springer
Open design science research systems: design principles and systems instantiations. PhD dissertation
Gau, M.
2023, May 19. Karlsruher Institut für Technologie (KIT)
Aligning Crowdworker Perspectives and Feedback Outcomes in Crowd-Feedback System Design
Haug, S.; Benke, I.; Maedche, A.
2023. Proceedings of the ACM on human-computer interaction, 7 (CSCW1), Art.-Nr.: 23. doi:10.1145/3579456
Accessing the Design Science Knowledge Base - A Search Engine for the Accumulation of Knowledge Across Decentrally Organized Publications
Gau, M.; Maedche, A.; Brocke, J. vom
2023. Design Science Research for a New Society: Society 5.0 – 18th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2023, Pretoria, South Africa, May 31 – June 2, 2023, Proceedings. Ed.: A. Gerber, 266 – 278, Springer Nature Switzerland. doi:10.1007/978-3-031-32808-4_17
AutoChemplete - Making Chemical Structural Formulas Accessible
Knaeble, M.; Sailer, G.; Chen, Z.; Schwarz, T.; Yang, K.; Nadj, M.; Stiefelhagen, R.; Maedche, A.
2023. W4A ’23: 20th International Web for All Conference Austin TX USA 30 April 2023- 1 May 2023, 173–174, Association for Computing Machinery (ACM). doi:10.1145/3587281.3587293
Making Usability Test Data Actionable! A Quantitative Test-Driven Prototyping Approach
Kretzer, F.; Maedche, A.
2023. CHI EA ’23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Ed.: A. Schmidt, 1–6, Association for Computing Machinery (ACM). doi:10.1145/3544549.3585659
CrowdSurfer: Seamlessly Integrating Crowd-Feedback Tasks nto Everyday Internet Surfing
Haug, S.; Benke, I.; Fischer, D.; Maedche, A.
2023. CHI ’23: CHI Conference on Human Factors in Computing Systems Hamburg Germany April 23 - 28, 2023. Ed.: A. Schmidt, Art.-Nr.: 553, Association for Computing Machinery (ACM). doi:10.1145/3544548.3580994
2022
Digital Infrastructure Evolution: A Digital Trace Data Study
Drechsler, K.; Grisold, T.; Gau, M.; Seidel, S.
2022. ICIS 2022. Proceedings
The Impact of Conversational Assistance on the Effective Use of Forecasting Support Systems: A Framed Field Experiment : Short Paper
Haug, S.; Ruoff, M.; Gnewuch, U.
2022. ICIS 2022 Proceedings. Vol.: 2, 1–9, AIS eLibrary (AISeL)
‘DNA’ of Virtual Organizing: Towards a New Construct to Theorize with Digital Trace Data
Grisold, T.; Yoo, Y.; Gau, M.
2022, August 9. 82nd Annual Meeting of the Academy of Management (2022), Seattle, WA, USA, August 5–9, 2022
Towards Space Mining: A Smart Space Management Solution to Minimize Indoor Spreading Risk of COVID-19
Otto, M.; Kipping, G.; Gau, M.; Grisold, T.; Brocke, J. vom
2022, June 3. 17th International Conference on Design Science Research in Information Systems and Technology (DESRIST 2022), St. Petersburg, FL, USA, June 1–3, 2022
DSR Buddy: A Conversational Agent Supporting Design Science Research Activities
Gau, M.; Maedche, A.; Brocke, J. vom
2022. Wirtschaftsinformatik 2022 Proceedings, 35, AIS eLibrary (AISeL)
Towards Routinely Using Virtual Reality in Higher Education
Majchrzak, T. A.; Radianti, J.; Fromm, J.; Gau, M.
2022. Proceedings of the 55th Hawaii International Conference on System Sciences (HICSS) : January 4-7, 2022, Hyatt Regency Maui, Hawaii, USA, 94–103, University of Hawai’i at Manoa / Hamilton Library. doi:10.24251/HICSS.2022.011
Towards Automatic Parsing of Structured Visual Content through the Use of Synthetic Data
Scholch, L.; Steinhauser, J.; Beichter, M.; Seibold, C.; Yang, K.; Knaeble, M.; Schwarz, T.; Maedche, A.; Stiefelhagen, R.
2022. 2022 26th International Conference on Pattern Recognition (ICPR), 1607–1613, Institute of Electrical and Electronics Engineers (IEEE). doi:10.1109/ICPR56361.2022.9956453
Leveraging Digital Citizen Science for Research Problem Discovery: Insights from a Home Office Challenge Participatory Action
Gau, M.; Greif-Winzrieth, A.; Mädche, A.
2022. Mensch und Computer 2022 – Workshopband, 04.-07. September 2022, Darmstadt. Ed.: K. Marky, Gesellschaft für Informatik (GI). doi:10.18420/muc2022-mci-ws05-314
Accessible Chemical Structural Formulas Through Interactive Document Labeling
Knaeble, M.; Chen, Z.; Schwarz, T.; Sailer, G.; Yang, K.; Stiefelhagen, R.; Maedche, A.
2022. Computers Helping People with Special Needs – 18th International Conference, ICCHP-AAATE 2022, Lecco, Italy, July 11–15, 2022, Proceedings, Part I. Ed.: K. Miesenberger, 38–46, Springer International Publishing. doi:10.1007/978-3-031-08648-9_6
Towards Automatic Parsing of Structured Visual Content through the Use of Synthetic Data
Schölch, L.; Steinhauser, J.; Beichter, M.; Seibold, C.; Yang, K.; Knäble, M.; Schwarz, T.; Mädche, A.; Stiefelhagen, R.
2022. doi:10.5445/IR/1000146801
Paintings, not Noise - The Role of Variety and Self-Determination in Labeling Work and its Effects on Psychological and Performance Outcomes
Knaeble, M.; Nadj, M.; Maedche, A.
2022. CHI 2022 Workshop - Self-Determination Theory in HCI: Shaping a Research Agenda
Toward User-adaptive Interactive Labeling on Crowdsourcing Platforms
Knaeble, M.; Nadj, M.; Maedche, A.; Loewe, N.
2022. CHI 2022 Workshop - REGROW: Reimagining Global Crowdsourcing for Better Human-AI Collaboration
2021
Crowd-Feedback in Information Systems Development: A State-of-the-Art Review
Haug, S.; Mädche, A.
2021. ICIS 2021 Proceedings, Association for Information Systems (AIS)
Coding Like a Rockstar : The Role of Social Influence on Action Patterns in GitHub
Grisold, T.; Gau, M.; Yoo, Y.
2021. ICIS 2021 Proceedings
Feeasy: An Interactive Crowd-Feedback System
Haug, S.; Maedche, A.
2021. Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery (ACM). doi:10.1145/3474349.3480224
Accelerating Deductive Coding of Qualitative Data: An Experimental Study on the Applicability of Crowdsourcing
Haug, S.; Rietz, T.; Maedche, A.
2021. Mensch und Computer 2021, MuC ’21, 5.-8.9.2021 Ingolstadt, 432–443, Association for Computing Machinery (ACM). doi:10.1145/3473856.3473873
Visual Complexity and Scene Recognition: How Low Can You Go?
Handali, J. P.; Schneider, J.; Gau, M.; Holzwarth, V.; Brocke, J. vom
2021. 2021 IEEE Virtual Reality and 3D User Interfaces (VR), 286–295, Institute of Electrical and Electronics Engineers (IEEE). doi:10.1109/VR50410.2021.00051
The Economist Historical Advertisements - Objects Dataset
Ammann, N.; Knaeble, M.; Nadj, M.; Maedche, A.; Kluge, S.; Gehrmann, L.; Stahl, F.
2021. doi:10.7801/386
The Economist Historical Advertisements - Faces Dataset
Ammann, N.; Knaeble, M.; Nadj, M.; Maedche, A.; Kluge, S.; Gehrmann, L.; Stahl, F.
2021. doi:10.7801/384
The Economist Historical Advertisements - Industry Subset ’Banking’
Kluge, S.; Gehrmann, L.; Stahl, F.; Knaeble, M.; Nadj, M.; Maedche, A.
2021. doi:10.7801/383
The Economist Historical Advertisements – Master Dataset
Kluge, S.; Gehrmann, L.; Stahl, F.; Knaeble, M.; Nadj, M.; Maedche, A.
2021. doi:10.7801/382
An Interactive Machine Learning System for Image Advertisements
Foerste, M.; Nadj, M.; Knaeble, M.; Maedche, A.; Gehrmann, L.; Stahl, F.
2021. Mensch und Computer 2021 (MuC ’21), Ingolstadt, 5.-8.9.2021, 574–577, Association for Computing Machinery (ACM). doi:10.1145/3473856.3474027
Journaling the Design Science Research Process : Transparency About the Making of Design Knowledge
Brocke, J. vom; Gau, M.; Mädche, A.
2021. The Next Wave of Sociotechnical Design – 16th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2021, Kristiansand, Norway, August 4–6, 2021, Proceedings. Ed.: L. Chandra Kruse, 131–136, Springer International Publishing. doi:10.1007/978-3-030-82405-1_15
MyResearchChallenge.digital - A Participatory Problem Discovery System for Citizen Design Science Research
Greif-Winzrieth, A.; Gau, M.
2021. The Next Wave of Sociotechnical Design – 16th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2021, Kristiansand, Norway, August 4–6, 2021, Proceedings. Ed.: L. Chandra Kruse, 112–117, Springer International Publishing. doi:10.1007/978-3-030-82405-1_13
When Data Fly: An Open Data Trading System in Vehicular Ad Hoc Networks
Lücking, M.; Kretzer, F.; Kannengießer, N.; Beigl, M.; Sunyaev, A.; Stork, W.
2021. Electronics, 10 (6), 654. doi:10.3390/electronics10060654
2020
Oracle or Teacher? A Systematic Overview of Research on Interactive Labeling for Machine Learning
Knaeble, M.; Nadj, M.; Maedche, A.
2020. 15. Internationale Tagung Wirtschaftsinformatik (WI 2020), Potsdam, 9 - 11 März 2020, 2–16, GITO Verlag. doi:10.30844/wi_2020_a1-knaeble
Smart Waste Collection Processes - A Case Study about Smart Device Implementation
Kamm, M.; Gau, M.; Schneider, J.; Brocke, J.
2020. Proceedings of the 53rd Hawaii International Conference on System Sciences, 6619–6628, Hawaii International Conference on System Sciences. doi:10.24251/HICSS.2020.810
Power to the Oracle? Design Principles for Interactive Labeling Systems in Machine Learning
Nadj, M.; Knaeble, M.; Li, M. X.; Maedche, A.
2020. Künstliche Intelligenz, 34, 131–142. doi:10.1007/s13218-020-00634-1
2018
Design principles for sensemaking support systems in environmental sustainability transformations
Seidel, S.; Chandra Kruse, L.; Székely, N.; Gau, M.; Stieger, D.
2018. (K. Peffers, T. Tuunanen, B. Niehaves & K. Lyytinen, Eds.) European journal of information systems, 27 (2), 221–247. doi:10.1057/s41303-017-0039-0
Tool Support for Design Science Research—Towards a Software Ecosystem: A Report from a DESRIST 2017 Workshop
Morana, S.; Brocke, J. vom; Maedche, A.; Seidel, S.; Adam, M. T. P.; Bub, U.; Fettke, P.; Gau, M.; Herwix, A.; Mullarkey, M. T.; Nguyen, H. D.; Sjöström, J.; Toreini, P.; Wessel, L.; Winter, R.
2018. Communications of the Association for Information Systems, 43 (Article 17), 239–256. doi:10.17705/1CAIS.04317
Designing Uncertainty-Aware Dashboards for Software Development Projects
Knaeble, M.; Nadj, M.; Maedche, A.
2018. 13th International Conference on Design Science Research in Information Systems and Technology (DESRIST), Chennai, IND, June 3-6, 2018, 1–15
2017
Tool-Support for Design Science Research: Design Principles and Instantiation
Brocke, J. vom; Fettke, P.; Gau, M.; Houy, C.; Maedche, A.; Morana, S.; Seidel, S.
2017. SSRN, 1–13. doi:10.2139/ssrn.2972803
2014
Green e-community: Sensemaking in Environmental Sustainability Transformations
Seidel, S.; Chandra, L.; Reuter, N.; Stieger, D.; Gau, M.
2014. Advancing the Impact of Design Science: Moving from Theory to Practice. Ed.: M. C. Tremblay, 438–442, Springer International Publishing. doi:10.1007/978-3-319-06701-8_41