Delray Beach, FL, USA

©2017 BY JAMES R. LEWIS

PUBLICATIONS

Books

Book Chapters

Book Chapters

Articles in Refereed Journals

Lewis, J. R.  (In press).  Comparison of four TAM item formats: Effect of response option labels and order.  To appear in Journal of Usability Studies.

Lewis, J. R.  (2018).  Is the report of the death of the construct of usability an exaggeration?  Journal of Usability Studies, 14(1), 1-7.

Lewis, J. R.  (2018).  Measuring perceived usability: SUS, UMUX, and CSUQ ratings for four everyday products.  DOI: 10.1080/10447318.2018.1533152.

Lewis, J. R.  (2018).  Comparison of item formats: Agreement vs. item-specific endpoints.  Journal of Usability Studies, 14(1), 48-60.

Lewis, J. R., & Sauro, J.  (2018).  Item benchmarks for the System Usability Scale.  Journal of Usability Studies, 13(3), 158-167.

Lewis, J. R.  (2018).  Measuring perceived usability: The CSUQ, SUS, and UMUX.  International Journal of Human-Computer Interaction, 34(12), 1148-1156.

Lewis, J. R.  (2018).  Investigating MOS-X ratings of synthetic and human voices.  Voice Interaction Design, 2(2), 1-22.

Lewis, J. R. (2018).  The System Usability Scale: Past, present, and future.  International Journal of Human-Computer Interaction, 34(7), 577-590.

Lewis, J. R., & Sauro, J.  (2017).  Can I leave this one out?  The effect of dropping an item from the SUS.  Journal of Usability Studies, 13(1), 38-46.

Lewis, J. R., & Sauro, J.  (2017).  Revisiting the factor structure of the System Usability Scale.  Journal of Usability Studies, 12(4), 183-192.

Lewis, J. R., & Erdinç, O.  (2017).  User experience rating scales with 7, 11, of 101 points: Does it matter?  Journal of Usability Studies, 12(2), 73-91.

Lewis, J. R.  (2016).  Standardized questionnaires for voice interaction design.  Voice Interaction Design, 1(1), 1-16.

Lah, U., & Lewis, J. R.  (2016).  How expertise affects a digital-rights-management-sharing application’s usability.  IEEE Software, 33(3), 76-82.

Blažica, B., & Lewis, J. R.  (2015).  Slovene translation of the System Usability Scale: The SUS-SI. International Journal of Human-Computer Interaction, 31(2), 112-117.

Lewis, J. R.  (2015).  Introduction to the special issue on usability and user experience: Psychometrics.  International Journal of Human-Computer Interaction, 31, 481-483.

Lewis, J. R.  (2015).  Introduction to the special issue on usability and user experience: Methodological Evolution.  International Journal of Human-Computer Interaction, 31, 555-556.

Lewis, J. R.  (2015).  When perishing isn’t a problem: Publication tips for usability practitioners.  Journal of Usability Studies, 11(1), 1-6.

Lewis, J. R., Brown, J., & Mayes, D. K.  (2015).  Psychometric evaluation of the EMO and the SUS in the context of a large-sample unmoderated usability study.  International Journal of Human-Computer Interaction, 31, 545-553.

Lewis, J. R., & Hardzinski, M. L.  (2015).  Investigating the psychometric properties of the Speech User Interface Service Quality questionnaire.  International Journal of Speech Technology, 18, 479-487.

Lewis, J. R., Utesch, B. S., & Maher, D. E.  (2015).  Measuring perceived usability: The SUS, UMUX-LITE, and AltUsability.  International Journal of Human-Computer Interaction, 31, 496-505.

Lewis, J. R. (2014). Usability: Lessons learned … and yet to be learned. International Journal of Human-Computer Interaction, 30(9), 663-684.

Lewis, J. R., & Mayes, D. K. (2014). Development and psychometric evaluation of the Emotional Metric Outcomes (EMO) questionnaire. International Journal of Human-Computer Interaction, 30(9), 685-702.

Sharit, J., Lisigurski, M., Andrade, A. D., Karanam, C., Nazi, K. M., Lewis, J. R., & Ruiz, J. G. (2014). The roles of health literacy, numeracy, and graph literacy on the usability of the VA’s Personal Health Record by Veterans. Journal of Usability Studies, 9(4), 173-193.

Erdinç, O., & Lewis, J. R.  (2013).  Psychometric evaluation of the T-CSUQ: The Turkish version of the Computer System Usability Questionnaire.  International Journal of Human-Computer Interaction, 29, 319-323.

Lewis, J. R.  (2013).  Critical review of “Intranet Satisfaction Questionnaire: Development and validation of a questionnaire to measure user satisfaction with the intranet”.  Interacting with Computers, doi: 10.1093/iwc/iwt011.

Lewis, J. R.  (2013).  Critical review of “The Usability Metric for User Experience”.  Interacting with Computers, doi: 10.1093/iwc/iwt013.

Lewis, J. R.  (2012).  Book review: “The voice in the machine: Building computers that understand speech”.  International Journal of Human-Computer Interaction, 28(10), 695-696.

Millet, B., Asfour, S., & Lewis, J. R.  (2009).  Selection-based virtual keyboard prototypes and data collection application.  Behavior Research Methods, 41, 951-956.

Commarford, P. M., Lewis, J. R., Smither, J. A., & Gentzler, M. D.  (2008).  A comparison of broad versus deep auditory menu structures.  Human Factors, 50, 77-89.

Lewis, J. R., & Sauro, J.  (2006).  When 100% really isn’t 100%: Improving the accuracy of small-sample estimates of completion rates.  Journal of Usability Studies, 3, 136-150.

Commarford, P. M., & Lewis, J. R. (2004). Models of throughput rates for dictation and voice spelling for handheld devices. International Journal of Speech Technology, 7, 69-79.

Lewis, J. R. (2004). Evaluating the potential effectiveness of automatic document analysis. International Journal of Speech Technology, 7, 35-43.

Lewis, J. R., & Commarford, P. M. (2003). Developing a voice-spelling alphabet for PDAs. IBM Systems Journal, 42, 624-638.

Polkosky, M. D., & Lewis, J. R. (2003). Expanding the MOS: Development and psychometric evaluation of the MOS-R and MOS-X. International Journal of Speech Technology, 6, 161-182.

Lewis, J. R. (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction, 14, 463-488.

Polkosky, M. D., & Lewis, J. R. (2002). Effect of auditory waiting cues on time estimation in speech recognition telephony applications. International Journal of Human-Computer Interaction, 14, 423-446.

Lewis, J. R. (2001). Evaluation of procedures for adjusting problem-discovery rates estimated from small samples. International Journal of Human-Computer Interaction, 13, 445-479.

Lewis, J. R. (2001). Introduction: Some current issues in usability evaluation. International Journal of Human-Computer Interaction, 13, 343-349.

Milenkovic, M., Happ, A. J., & Lewis, J. R. (1997). Design decisions for a voice navigation system. International Journal of Speech Technology, 2, 71-79.

Lewis, J. R. (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 57-78.

Lewis, J. R. (1994). Sample sizes for usability studies: Additional considerations. Human Factors, 36, 368-378.

Lewis, J. R. (1993). Multipoint scales: Mean and median differences and observed significance levels. International Journal of Human-Computer Interaction, 5, 383-392.

Lewis, J. R. (1993). Pairs of Latin squares that produce digram-balanced Greco-Latin designs: A BASIC program. Behavior Research Methods, Instruments, & Computers, 25, 414-415.

Lewis, J. R. (1991). An after-scenario questionnaire for usability studies: Psychometric evaluation over three trials. SIGCHI Bulletin, 23 (4), 79.

Lewis, J. R. (1991). Psychometric evaluation of an after- scenario questionnaire for computer usability studies: The ASQ. SIGCHI Bulletin, 23 (1), 78-81.

Lewis, J. R. (1987). Slot vs. insertion magnetic stripe readers: User performance and preference. Human Factors, 29, 461-464.

Conference Papers

Lewis, J. R., Utesch, B. S., & Maher, D. E. (2015). Investigating the correspondence between UMUX-LITE and SUS scores. In A. Marcus (Ed.), DUXU 2015, Part I (pp. 204-211). Cham, Switzerland: Springer.

Nah, F., Galletta, D., Knight, M., Lewis, J. R., Pruitt, J., Salvendy, G., Sheng, H., & Wichansky, A.  (2015).  Creating greater synergy between HCI academia and practice.  In F. F.-H. Nah & C.-H. Tan (Eds.), HCIB 2015 (pp. 727-738).  Cham, Switzerland: Springer.

Lewis, J. R., Utesch, B. S., & Maher, D. E. (2013). UMUX-LITE – When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099-2102). Paris, France: Association for Computing Machinery.

Sauro, J., & Lewis, J. R.  (2011).  When designing usability questionnaires, does it hurt to be positive?  In Proceedings of CHI 2011 (pp. 2215-2223).  Vancouver, Canada: Association for Computing Machinery.  Nominated for Best of CHI award.

 

Millet, B., Asfour, S., Lewis, J. R., & Onar-Thomas, A.  (2010).  Five-key text entry: An experimental comparison of novice performance with three keyboard layouts.  In Proceedings of the 3rd International Conference on Applied Human Factors and Ergonomics (pp. 1-10).  Miami, FL: USA Publishing.

 

Sauro, J., & Lewis, J. R.  (2010).  Average task times in usability tests: What to report?  In Proceedings of CHI 2010 (pp. 2347-2350).  Atlanta, GA: Association for Computing Machinery.

 

Lewis, J. R., & Sauro, J.  (2009).  The factor structure of the System Usability Scale.  In M. Kurosu, (Ed.), Proceedings of HCII 2009, Human-Centered Design (pp. 94-103).  Berlin, Germany: Springer-Verlag.

 

Sauro, J., & Lewis, J. R.  (2009).  Correlations among prototypical usability metrics: Evidence for the construct of usability.  In Proceedings of CHI 2009 (pp. 1609-1618).  Boston, MA: Association for Computing Machinery.  Nominated for Best of CHI award.

 

Millet, B., Asfour, S., & Lewis, J. R.  (2008).  Designing a hybrid layout for a five-key text entry technique.  In Proceedings of the 20th Annual International Occupational Ergonomics and Safety Conference (pp. 156-162).  Chicago, IL: International Society of Occupational Ergonomics and Safety.

 

Lewis, J. R. (2006). Effectiveness of various automated readability measures for the competitive evaluation of user documentation. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 624-628). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R. (2006). Effect of level of problem description on problem discovery rates: Two case studies. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 2567-2571). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Kotan, C., & Lewis, J. R. (2006). Investigation of confirmation strategies for speech recognition applications. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 728-732). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R., Commarford, P. M., & Kotan, C. (2006). Web-based comparison of two styles of auditory presentation: All TTS versus rapidly mixed TTS and recordings. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 723-727). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Sauro, J., & Lewis, J. R. (2005). Estimating completion rates from small samples using binomial confidence intervals: Comparisons and recommendations. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 2100-2104). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Commarford, P. M., & Lewis, J. R. (2005). Optimizing the pause length before presentation of global navigation commands. In Proceedings of HCI International 2005: Volume 2 - The Management of Information: E-Business, the Web, and Mobile Computing (pp. 1-7). St. Louis, MO: Mira Digital Publication.

 

Lewis, J. R. (2005). Accuracy error span evaluations: Implications for user interface design of speech dictation and handwriting recognition applications. In Proceedings of HCI International 2005: Vol. 6 - Human Factors Issues in Human-Computer Interaction (pp. 1-8). St. Louis, MO: Mira Digital Publication.

 

Lewis, J. R. (2005). Frequency distributions for names and unconstrained words associated with the letters of the English alphabet. In Proceedings of HCI International 2005: Posters (pp. 1-5). St. Louis, MO: Mira Digital Publication.

 

Lewis, J. R. (2004). Selection accuracy with pen selection slots. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 783-787). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R. (2004). Effect of speaker and sampling rate on MOS-X ratings of concatenative TTS voices. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 759-763). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Turner, C. W., Nielsen, J., & Lewis, J. R. (2002). Current issues in the determination of usability test sample size: How many users is enough? In Proceedings of Usability Professionals Association UPA '02.

 

Lewis, J. R. (2001). Psychometric properties of the Mean Opinion Scale. In Proceedings of HCI International 2001: Usability Evaluation and Interface Design (pp. 149-153). Mahwah, NJ: Lawrence Erlbaum.

 

Wang, H., & Lewis, J. R. (2001). Intelligibility and acceptability of short phrases generated by embedded text-to-speech engines. In Proceedings of HCI International 2001: Usability Evaluation and Interface Design (pp. 144-148). Mahwah, NJ: Lawrence Erlbaum.

 

Lewis, J. R. (1999). Effect of error correction strategy on speech dictation throughput. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 457-461). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R., LaLomia, M. J., & Kennedy, P. J. (1999). Evaluation of typing key layouts for stylus input. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 420-424). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R., Kennedy, P. J., & LaLomia, M. J., (1999). Development of a digram-based typing key layout for single-finger/stylus input. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 415-419). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R. (1999). Input rates and user preference for three small-screen input methods: Standard keyboard, predictive keyboard, and handwriting. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 425-428). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R., Allard, D. J., & Hudson, H. D. (1999). Predictive keyboard design study: Effects of word populations, number of displayed letters, and number of transitional probability tables. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 429-432). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R. (1999). Information for PDA application design: Calendar entry and name length statistics. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 467-470). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lewis, J. R. (1999). Trade-offs in the design of the IBM computer usability satisfaction questionnaires. In H. Bullinger and J. Ziegler (eds.)., Human-Computer Interaction: Ergonomics and User Interfaces – Vol. I (pp. 1023-1027). Mahwah, NJ: Lawrence Erlbaum.

 

Lewis, J. R. (1996). Binomial confidence intervals for small sample usability studies. In G. Salvendy and A. Ozok (eds.), Advances in Applied Ergonomics: Proceedings of the 1st International Conference on Applied Ergonomics -- ICAE '96 (pp. 732-737). Istanbul, Turkey: USA Publishing.

 

Lewis, J. R. (1996). Reaping the benefits of modern usability evaluation: The Simon story. In G. Salvendy and A. Ozok (eds.), Advances in Applied Ergonomics: Proceedings of the 1st International Conference on Applied Ergonomics -- ICAE '96 (pp. 752-757). Istanbul, Turkey: USA Publishing.

 

Lewis, J. R. (1993). Problem discovery in usability studies: A model based on the binomial probability formula. In Proceedings of the Fifth International Conference on Human-Computer Interaction (pp. 666-671). Orlando, FL: Elsevier.

 

Lewis, J. R. (1992). Psychometric evaluation of the post-study system usability questionnaire: The PSSUQ. In Proceedings of the Human Factors Society 36th Annual Meeting (pp. 1259-1263). Atlanta, GA: Human Factors Society.

 

Lewis, J. R. (1991). A rank-based method for the usability comparison of competing products. In Proceedings of the Human Factors Society 35th Annual Meeting (pp. 1312-1316). San Francisco, CA: Human Factors Society.

 

Loricchio, D. F. & Lewis, J. R. (1991). User assessment of standard and reduced-size numeric keypads. In Proceedings of the Human Factors Society 35th Annual Meeting (pp. 251-252). San Francisco, CA: Human Factors Society.

 

Lewis, J. R. (1990). The Iowa Silent Reading Test's reading comprehension section: Local norms and predictive validity for usability studies. In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 922-926). Orlando, FL: Human Factors Society.

 

Lewis, J. R., Henry, S. C., & Mack, R. L. (1990). Integrated office software benchmarks: A case study. In Human-Computer Interaction - INTERACT '90, Proceedings of the Third IFIP Conference on Human-Computer Interaction (pp. 337-343). Cambridge, England: Elsevier Science Publishers.

 

Lewis, J. R. (1989). Pairs of Latin squares to counterbalance sequential effects and pairing of conditions and stimuli. In Proceedings of the Human Factors Society 33rd Annual Meeting (pp. 1223-1227). Denver, CO: Human Factors Society.

 

Lewis, J. R. & Alfonso, P. (1989). Developing the IBM Personal System/2 mouse: An industrial design/human factors collaboration. In Proceedings of the Sixth Symposium on Human Factors and Industrial Design in Consumer Products - Interface 89 (pp. 263-267). Pittsburgh, PA: Human Factors Society.

 

Kennedy, P. J., Alfonso, P., & Lewis, J. R. (1989). Industrial design and human factors contributions to the design of IBM's PS/2. In Proceedings of the Sixth Symposium on Human Factors and Industrial Design in Consumer Products - Interface 89 (pp. 221-224). Pittsburgh, PA: Human Factors Society.

 

Snyder, K. M. & Lewis, J. R. (1989). Cognitive representations of DOS commands as a function of expertise. In Proceedings of the 22nd Annual Hawaii International Conference on System Science (pp. 447-456). Kailua-Kona, Hawaii: Computer Society of the IEEE.

 

Lewis, J. R. (1986). Power switches: Some user expectations and preferences. In Proceedings of the Human Factors Society 30th Annual Meeting (pp. 895-899). Dayton, OH: Human Factors Society.

 

Kennedy, P. J. & Lewis, J. R. (1985). A method of analyzing personal computer use in an application environment. In Proceedings of the Human Factors Society 29th Annual Meeting (pp. 1057-1060). Baltimore, MD: Human Factors Society.

 

Snyder, K. M., Happ, A. J., Malcus, L., Paap, K. R., & Lewis, J. R. (1985). Using cognitive models to create menus. In Proceedings of the Human Factors Society 29th Annual Meeting (pp. 655-658). Baltimore, MD: Human Factors Society.

 

Lewis, J. R. (1984). Association of visually coded functions with an alternate key. In Proceedings of the Human Factors Society 28th Annual Meeting (pp. 973-976). San Antonio, TX: Human Factors Society.

 

Kennedy, P. J. & Lewis, J. R. (1983). Automated data collection. In Proceedings of the Human Factors Society 27th Annual Meeting (pp. 546-547). Norfolk, VA: Human Factors Society.

 

Happ, A. J. & Lewis, J. R. (1983). The effect of screen boundary, familiarity, and data type on user's decision to scroll or window. In Proceedings of the Human Factors Society 27th Annual Meeting (pp. 512-515). Norfolk, VA: Human Factors Society.

 

Lewis, J. R. (1982). Testing small system customer set-up. In Proceedings of the Human Factors Society 26th Annual Meeting (pp. 718-720). Dayton, OH: Human Factors Society.

Other Articles