Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TEST] TWE: IS22: RP012: Intern I008 Exit Interview Recording: Transcribe: Otter #637

Closed
57 of 59 tasks
mh-faraji opened this issue Oct 23, 2024 · 7 comments
Closed
57 of 59 tasks
Assignees
Labels
complexity: small feature: recording transcription feature: research All issues involving research feature: template test (step 3) new issue created by assignee of feature: test a template to see if it works without modification Participant Type: Intern ready for research lead Research: RP012 Intern Exit Interviews role: UI/UX research size: 0.25pt Can be done in 1.5 hours

Comments

@mh-faraji
Copy link
Member

mh-faraji commented Oct 23, 2024

Dependencies

  • Org rep has decided on the choice of the transcription software: we are testing using Otter in this issue
  • The assignee is added to 1Password's Internship UI/UX vault
  • Interview transcription set-up phase issue has been completed

Overview

We need to transcribe RP012's Intern I008 Exit interview recordings so that we can move on to clean up and de-identify the transcripts.

During these tasks you will be asked to add link to the Resources/Instructions section, and that section is at the bottom of this issue (go view it now).

Another tip is to use split browser windows side by side when working on any GitHub issue, so you can edit the issue on one window, and check the resources or click through links on the other window to avoid a lot of back and forth. Make sure to refresh both windows to reflect any changes you made, including updating the issue or checking the boxes on one of them.

Action Items

  • UX lead asks admin to add the team member working on this issue to the 1Password internship-UX's vault so that they can have access to [email protected] Google account or other software account if they need it.
  • UX lead adds the assignee to the Internship - PII's "My Drive" as a Content Manager so that they have access to internship - PII's My Drive where the recordings and transcriptions with PII are stored.
    • UX lead accesses the Internship - PII's "My Drive"
    • Choose "Manage members", which is located towards the top right side of the browser Screenshot 2023-08-09 at 6 09 36 PM
    • Enter the assignee's email address and select the role as "Content Manager"
    • Confirm with the assignee that they have access to the Internship - PII's "My Drive"

Customize Resource Links

  • Customize Resource for Wiki Page Link

    • Go to the wiki page: Research Output Overview (Resources # 1.01)
    • Find relevant wiki page for RP012
    • Copy the link for the wiki page
    • In Resources # 2.01, place the link you just copied between parentheses at the end of the line with no space in between the right bracket ] and the left parenthesis (, so it turns into a hyperlink
    • Choose "Update comment" in GitHub and make sure all the checkboxes above have been checked Screenshot 2023-02-21 at 6 47 15 PM
  • Customize Resource for this Research Plan's Google Drive Folder

    • Open the Google Drive's Research by Plan # and Name Folder (Resources # 1.02)
    • Choose the RP012 folder
    • Copy the link of the RP012 folder
      1. Choose the three vertical dots on the right side of the RP012 folder Screenshot 2023-10-10 at 5 58 13 PM
      2. Choose "Share"
      3. Choose "Copy Link" and "Done"
    • In Resources # 2.02, place the link you just copied between parentheses at the end of the line with no space in between the right bracket ] and the left parenthesis (, so it turns into a hyperlink
    • Choose "Update comment" in GitHub and make sure all the checkboxes above have been checked
  • Customize Resource for RP012's Interview Recordings and Transcriptions Tracking Sheet

    • Open the RP012 folder if it is not open yet (Resources # 2.02)
    • Copy the link of TWE: IS22: RP012: Intern Exit Interview Recordings and Transcriptions Tracking Sheet
      1. Choose the three vertical dots on the right side of the spreadsheet Screenshot 2023-10-10 at 5 58 13 PM
      2. Choose "Share"
      3. Choose "Copy link" and "Done"
    • In Resources # 2.03, place the link you just copied between parentheses at the end of the line with no space in between the right bracket ] and the left parenthesis (, so it turns into a hyperlink
    • Choose "Update comment" in GitHub and make sure all the checkboxes above have been checked
  • Customize Resource for Intern I008's interview recording file stored in the Internship - PII's My Drive

    • Make sure you are logged into your Google account associated with TWE project so you will be able to access the Internship - PII's 'My Drive' in the next steps
    • Choose Shared drives > Internship - PII > Internship - PII
    • Choose TWE Interview Recordings by Plan # folder in Internship - PII's My drive (Resources # 1.03)
    • Locate the video recording folder for RP012 inside the folder TWE Interview Recordings by Plan #
    • Copy the link of the video recording folder for RP012
      1. Choose the three vertical dots on the right side of the folder Screenshot 2023-10-10 at 5 58 13 PM
      2. Choose "Share"
      3. Choose "Copy Link"
    • In Resources # 2.04, place the link you just copied between parentheses at the end of the line with no space in between the right bracket ] and the left parenthesis (, so it turns into a hyperlink
    • Choose "Update comment" in GitHub and make sure all the checkboxes above have been checked
    • Open the video recording folder for RP012 if it is not open yet (Resources # 2.04)
    • Locate Intern I008's interview recording file
    • Copy the link of the video recording file for Intern I008
      1. Choose the three vertical dots on the right side of the folder Screenshot 2023-10-10 at 5 58 13 PM
      2. Choose "Share"
      3. Choose "Copy Link"
    • In Resources # 2.05, place the link you just copied between parentheses at the end of the line with no space in between the right bracket ] and the left parenthesis (, so it turns into a hyperlink
    • Choose "Update comment" in GitHub and make sure all the checkboxes above have been checked

Rename Uploaded Recording Video Files If Needed

  • Go to the recording file(s) linked in Resource # 2.05
  • Make sure the Intern I008 interview recording video file in the folder is named as RP012-UX Researcher Abbreviation###-Intern Abbreviation###
    • If the recording video file is not in the format above, please rename the recording files in the format above first before taking any more actions
    • An example looks like this: RP006-U007-I001.mp4, which means this is an interview recording for research plan 006, conducted by UX Researcher 007, and the interviewee is Intern 001
    • In case if you would like to double check to ensure the accuracy, both UX Researcher Abbreviation### and Intern Abbreviation### can be found in TWE: IS22: RP012: Intern Exit Interview Roll Call and Session Table in RP012 folder (linked in Resources # 2.02)

Transcribe the Interview when transcripts are not available

  • Open RP012 Interview Recording Folder linked in Resource # 2.04 if it is not open yet
  • Check to see if Intern I008's interview recording file has been transcribed or not
    • If yes, move on to #### Update Interview Recordings and Transcriptions Tracking Sheet section
    • If no, do the following to transcribe Intern I008's interview file(s)
      • Download Intern I008's interview recording that needs to be transcribed from the Google Drive (Resources # 2.05) to a temporary folder locally
      • Log into 1password (Resources # 1.04) to access the transcription software's account information if needed
        1. Choose internship-UI/UX vault
        2. Choose the transcription software account or the Internship-UX Google account to see login info if needed
      • Access the account by copying and pasting the login info from 1password vault
      • Confirm you can access the account you need
      • Complete the following steps using the transcription software:
        • Import or upload the video file that you need to transcribe
        • Wait for the software to transcribe the file for you
        • Once finished, download the .txt transcript file
        • Rename the .txt transcript file you downloaded in RP012-UX Researcher Abbreviation###-Intern Abbreviation### format
          • An example looks like this: RP006-U007-I001.txt, which means this is an interview transcript for research plan 006, conducted by UX Researcher 007, and the interviewee is Intern 001
          • Please double-check the UX Researcher number and participant number in TWE: IS22: RP012: Intern Exit Interview Roll Call and Session Table in RP012 folder (linked in Resources # 2.02)
        • Upload the .txt file into RP012's interview recording folder (Resources # 2.04)
          • So there will be two types of files named in the RP012-UX Researcher Abbreviation###-Intern Abbreviation### format. One is a .mp4 video from the interview while the other one is a transcript in .txt format.
      • Delete the local temporary folder with recording file(s) from your own device, such as your laptop

Update Interview Recordings and Transcriptions Tracking Sheet

  • Open the Interview Recordings and Transcriptions Tracking Sheet (linked in Resources # 2.03) 
  • In Column A of the Tracking Sheet, enter the participant number(s)
    1. The participant number is reflected in this issue's title
    2. Refer to the "Session Table" tab of TWE: IS22: RP012: Intern Exit Interview Roll Call and Session Table inside Google Drive Folder: RP012 (Resources # 2.02) if you need a source to double check on participants' information
  • In Column B of the Tracking Sheet, enter the recording link(s)
    1. Go to Intern I008's interview recording file (Resources # 2.05)
    2. Choose the three vertical dots on the right side of the file Screenshot 2023-10-10 at 5 58 13 PM
    3. Choose "Share"
    4. Choose "Copy Link"
    5. Paste the link of the .mp4 file(s) into the corresponding participant's cell in Column B Recording Link of the Tracking Sheet (Resources # 2.03)
  • In Column C, enter the transcription link(s)
    1. Go to RP012's interview recording folder (Resources # 2.04)
    2. Locate the .txt file(s) for Intern I008
    3. Choose the three vertical dots on the right side of the file Screenshot 2023-10-10 at 5 58 13 PM
    4. Choose "Share"
    5. Choose "Copy Link"
    6. Paste the link of the .txt file(s) into the corresponding participant's cell in Column C Transcription Link (on Internship - PII's private drive, in .txt format) of the Tracking Sheet (Resources # 2.03)
    7. In Resources # 2.06, place the link you just copied between parentheses at the end of the line with no space in between the right bracket ] and the left parenthesis (, so it turns into a hyperlink
    8. Choose "Update comment" in GitHub and make sure all the checkboxes above have been checked

Review and hand off

  • Review with UXR Leads to make sure the transcription is done properly
  • The assignee checks in with UXR Lead to create new issues for cleaning up and de-identifying the transcripts if needed
  • UXR Lead or PM removes the assignee from the Internship - PII's "My Drive" when closing the issue if the assignee does not need to access the Internship - PII's "My Drive" any longer
  • Product sign-off

Resources/Instructions

Resources for creating this issue

1.01 Wiki: Research Output Overview
1.02 Google Drive Folder: Research by Plan # and Name
1.03* TWE Interview Recordings by Plan #
1.04 1password

Resources gathered during the completion of this issue

2.01 Wiki: Research Plan: RP012
2.02 Google Drive Folder: RP012
2.03 TWE: IS22: RP012: Intern Exit Interview Recordings and Transcriptions Tracking Sheet
2.04* RP012 Interview Recording Folder
2.05* RP012 Intern I008 Interview Recording File
2.06* RP012 Intern I008 Interview Recording Transcript - Otter

  • indicates this folder can only be accessed from the Internship - PII's "My Drive"
@mh-faraji mh-faraji self-assigned this Oct 23, 2024
@mh-faraji mh-faraji added feature: recording transcription feature: research All issues involving research Participant Type: Intern Research: RP012 Intern Exit Interviews size: 0.25pt Can be done in 1.5 hours role: UI/UX research milestone: missing complexity: small feature: template test (step 3) new issue created by assignee of feature: test a template to see if it works without modification labels Oct 23, 2024
@github-project-automation github-project-automation bot moved this to New Issue Approval in P: TWE: Project Board Oct 23, 2024
@mh-faraji mh-faraji moved this from New Issue Approval to In progress (actively working) in P: TWE: Project Board Oct 23, 2024
@mh-faraji mh-faraji changed the title [TEST] TWE: IS22: RP012: Intern 008 Exit Interview Recording: Transcribe: Otter TWE: IS22: RPRP012: Intern I005 Exit Interview Recording: Transcribe: Otter Oct 23, 2024
@mh-faraji mh-faraji added Research: RP012 Intern Exit Interviews and removed Research: RP012 Intern Exit Interviews labels Oct 23, 2024
@mh-faraji mh-faraji added this to the 07.01.01 Research Analysis milestone Oct 23, 2024
@pandanista pandanista changed the title TWE: IS22: RPRP012: Intern I005 Exit Interview Recording: Transcribe: Otter [TEST] TWE: IS22: RP012: Intern I005 Exit Interview Recording: Transcribe: Otter Oct 24, 2024
@mh-faraji mh-faraji moved this from In progress (actively working) to Questions/Review in P: TWE: Project Board Oct 24, 2024
@mh-faraji
Copy link
Member Author

mh-faraji commented Oct 24, 2024

Update:
The transcription of RP012's Intern I008 Exit interview recordings is completed.
Two transcripts from the file (RP012-U006-I008) are available as samples, processed by Otter.ai (#637) and Torbscribe (#635). Both tools identified the speakers and provided timestamps, which will accelerate the cleaning and de-identification process. However, I believe Otter.ai's output will also benefit the qualitative analysis phase, making it faster, more accurate, and more consistent. In addition to the transcript, it also provides a summary of the interview, it outlines the interviewee's responses, and its AI Chat feature can pose and answer questions about the transcript. The summary and the outline are available at the end of the transcript 2.06* RP012 Intern I008 Interview Recording Transcript.

@pandanista
Copy link
Member

@mh-faraji: Would you provide an estimate on how long it took to accomplish this issue?

According to Otter.ai,

300 monthly transcription minutes; 30 minutes per conversation; Import and transcribe 3 audio or video files lifetime per user

  • I think the 300 minutes refers to transcription during the meetings minutes, but I could be wrong here. Would you please look into that?
  • It seems like they still only allow 3 video files uploaded and transcribed lifetime, and the "import and transcribe" is the main function that apply to us.

@mh-faraji
Copy link
Member Author

mh-faraji commented Oct 24, 2024

@pandanista I think you are right. I tried to upload another file, but it did not allow, and this message popped up:
Screenshot 2024-10-24 at 12 11 52 PM

@pandanista
Copy link
Member

pandanista commented Oct 24, 2024

I am glad we have at least one transcript sample from otter.

Added RP012 Intern I008 Interview Recording Transcript - Otter to #629 so we can compare the transcript quality.

@pandanista
Copy link
Member

@mh-faraji Also, was it the internship-ux account?

@mh-faraji
Copy link
Member Author

Yes, it was.

@pandanista
Copy link
Member

pandanista commented Oct 29, 2024

Tagging @sunannie27 and @KC-skc for visibility.

@github-project-automation github-project-automation bot moved this from Questions/Review to Done in P: TWE: Project Board Oct 29, 2024
@pandanista pandanista changed the title [TEST] TWE: IS22: RP012: Intern I005 Exit Interview Recording: Transcribe: Otter [TEST] TWE: IS22: RP012: Intern I008 Exit Interview Recording: Transcribe: Otter Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
complexity: small feature: recording transcription feature: research All issues involving research feature: template test (step 3) new issue created by assignee of feature: test a template to see if it works without modification Participant Type: Intern ready for research lead Research: RP012 Intern Exit Interviews role: UI/UX research size: 0.25pt Can be done in 1.5 hours
Projects
Development

No branches or pull requests

2 participants