sketchucation logo sketchucation
    • Login
    ℹ️ Licensed Extensions | FredoBatch, ElevationProfile, FredoSketch, LayOps, MatSim and Pic2Shape will require license from Sept 1st More Info

    [Plugin] Virtual Assistant - v1.0.2 - 28 Dec. 2019

    Scheduled Pinned Locked Moved Plugins
    13 Posts 4 Posters 4.0k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • samuel_tS Offline
      samuel_t
      last edited by samuel_t

      Hello! πŸ˜„ I created a plugin that allows you to interact with SketchUp (in English) with voice or text. Speech recognition is only available on Windows. Let me know if you want bot handle more actions.

      => You can download it from SketchUcation PluginStore.

      Demos

      VAT Plugin Chat Demo #1

      VAT Plugin Chat Demo #2

      1 Reply Last reply Reply Quote 0
      • samuel_tS Offline
        samuel_t
        last edited by

        What's new in 1.0.1 version?

        • Chat bot understands following sentences*:

        Open a file.
        Select first entity.
        Select first group.
        Select first component.
        Move selection 1m along X axis, 1m along Y axis and 1m along Z axis.
        Rotate selection by 90 degrees.
        Increase selection size 2 times.

        • There is a "Virtual Assistant" toolbar in SU.

        (*) Sentences are customizable.

        Download latest Virtual Assistant plugin from SketchUcation PluginStore.

        1 Reply Last reply Reply Quote 0
        • A Offline
          Anton_S
          last edited by

          Whoa! That's some nice work there. I can't wait to check it out. This has so much potential.

          1 Reply Last reply Reply Quote 0
          • A Offline
            Anton_S
            last edited by

            Is there a way to enable microphone? It would be good if it listens for your messages while the chat box window is minimized or not active.

            1 Reply Last reply Reply Quote 0
            • samuel_tS Offline
              samuel_t
              last edited by

              @anton_s said:

              Whoa! That's some nice work there. I can't wait to check it out. This has so much potential.

              Thank you Anton! Let me know if you have ideas.

              @anton_s said:

              Is there a way to enable microphone? It would be good if it listens for your messages while the chat box window is minimized or not active.

              I found no way to enable microphone for now! 😞

              1 Reply Last reply Reply Quote 0
              • A Offline
                Anton_S
                last edited by

                @samuel_t said:

                Let me know if you have ideas.

                I have a few ideas, including:

                • Selecting an entity with name: select entity SomeEntityName
                • Look at entity with name
                • Zoom extents at entity with name / selected
                • Delete entity with name/selected
                • Active tool [ToolName]

                @samuel_t said:

                I found no way to enable microphone for now! 😞

                If you google JavaScript speech to text, you should see a number of solutions and libraries. For example, check out https://tutorialzine.com/2017/08/converting-from-speech-to-text-with-javascript

                If user says an unrecognizable command, list a number of commands the are similar; allow creating aliases.

                1 Reply Last reply Reply Quote 0
                • samuel_tS Offline
                  samuel_t
                  last edited by

                  @Anton_S

                  Thanks again!

                  1 Reply Last reply Reply Quote 0
                  • samuel_tS Offline
                    samuel_t
                    last edited by

                    Good news: next version will include speech recognition. πŸ˜›

                    1 Reply Last reply Reply Quote 0
                    • samuel_tS Offline
                      samuel_t
                      last edited by

                      What's new in 1.0.2 version?

                      • Chat bot listens to your voice/microphone.
                        This requires Windows 64 bits & Chrome 25+.

                      • Chat bot understands following sentences:

                        • Select group with name ...
                        • Select instance with name ...
                        • Name ...
                        • Duplicate and name ...
                        • Clear selection.
                        • Delete.
                        • Activate Push Pull tool.
                        • Activate Rectangle tool.
                        • Activate ... tool.
                        • Write ...
                      • A "Did you mean" algo. was implemented.

                      • Chat bot understands somewhat quantities.

                      Download latest Virtual Assistant plugin from SketchUcation PluginStore.

                      1 Reply Last reply Reply Quote 0
                      • A Offline
                        Anton_S
                        last edited by

                        Nice! I tried the update with the microphone option and it works quite well. I do realize it is much faster to do things without saying but this can always be expanded to perform more complex operations.

                        1 Reply Last reply Reply Quote 0
                        • F Offline
                          faust07
                          last edited by

                          It is amazing when geniuses are found. I am thrilled and can hardly wait for the results. I would be particularly excited about the synergies for the MSPhysics area - voice input ...
                          Thanks again!

                          1 Reply Last reply Reply Quote 0
                          • B Offline
                            bigfoot03242
                            last edited by

                            This is a great Idea Does it use only windows is tht an additional function of cortana or narrator

                            1 Reply Last reply Reply Quote 0
                            • samuel_tS Offline
                              samuel_t
                              last edited by

                              @bigfoot03242 said:

                              This is a great Idea Does it use only windows is tht an additional function of cortana or narrator

                              It uses Google Chrome Speech Recognition.

                              1 Reply Last reply Reply Quote 0
                              • 1 / 1
                              • First post
                                Last post
                              Buy SketchPlus
                              Buy SUbD
                              Buy WrapR
                              Buy eBook
                              Buy Modelur
                              Buy Vertex Tools
                              Buy SketchCuisine
                              Buy FormFonts

                              Advertisement