merge master (#1812)

* Ref resolving improvements (#1708)

* composite external resolving revised

* preprocessor (header resolving)

* tmp YAML merging override to unblock arm-recoveryservicesbackup (#1713)

[NOTE] - Admin merging because TravisCI has dishonored itself and should be shamed.

* tmp composite swagger merge override to unblock arm-recoveryservicesbackup

* skip test

* Added code to change the data type of ItemType (#1711)

* Extension proposal (#1638)

[Admin merging  - docs ]
* fixed typo in autorest.json files

* Fixed linefeeds, better c# simplifier

* regenerated python (line endings)

* regenerated ruby (line endings)

* regenerated nodejs (line endings)

* regenerated c# (line endings)

* regenerated samples (line endings)

* merged from master and regenerated

* whitelist assemblies that should be signed

* imported draft document

* [Ruby] Making credentials nil by default (#1677)

* Making credentials nil by default

* Regenerated Samples

* [Linter Rules] M1005, M1006, M1007 & M1009 (#1706)

* Implement OperationNameValidation Rule for M1005, M1006, M1007 & M1009

* Update warning message

* Adding swagger modeler validation tests

* Correcting the clean swagger and improving the rules correctness

* [linter Rules] Swagger rules M2005 - long running operation must have valid terminal status codes (#1707)

* Long running operations must have valid success response codes.

* Adding swagger modeler validation tests for invalid long running reponse codes

* Adding nullable check on response codes before schema resolver

* Adding positive test case for correctly modeled x-ms-long-running

* Correct the merge conflicted resx file syntax

* Add insights swagger spec test, add vm extensions to swagger and schema (#1512)

* Add ServiceBus AzureResourceSchema acceptance test

* Add insights swagger spec test

* Add minLength and maxLength support to schema generator

* Fixing logic to add missing schema resources

* Working on discriminator stuff

* Change schemas that only have an 'object' type definition to be empty

* Add compute test with extension properties

* Add additional enum values for extensionType discriminator

* missing test files

* Update SwaggerSpecHelper.cs

unnecessary file change

* Update SwaggerSpecHelper.cs

unnecessary file change

* [Linter Rules] M2008 for x-ms-mutability extension (#1712)

* x-ms-mutability swagger linter rules

* Removing <<<< characters

* undo unblocking fix (#1718)

* Improvements for Mono & Docker users (#1714)

* Make Docker shell script executable

* Remove unnecessary dependencies

* Update documentation for AutoRest Mono/Docker usage

* Better preprocessor and 3 bugfixes (#1717)

* general $inc handling

* more preproc magic

* move up path params and do cleanup

* fixed Stream.Null codegen

* enum default escaping

* added operationId and title as optional properties of the example schema (#1725)

* Fix NullReferenceException (#1722)

See #1721 for problem and solution.

* minor code cleanup in swagger validation rule file (#1724)

* Generator should not flatten out parameters if they are polymorphic (#1726)

* Changes to markdown file generation in AzureResourceSchema generator. (#1715)

The doc team requested the following changes so they can start consuming
the generated markdown help files.
- generate a separate file for each resource type
- use namespace/type instead of just namespace
- include optional properties in the template sample
- move type into its own column
- remove line-breaks from tables
- re-word some of the boiler-plate text
- don't bold text when listing a type's values

* Relaxing naming rules to accomodate suffix words in names

* [Go] Telemetry tiny detail (#1731)

* Fix for credentials switch (#1728)

* Fix for list and dict serialization (#1727)

* [Java] AutoRest changes by runtime changes (#1703)

* Fix some tests with beta5 snapshot runtime

* Runtime change: mapperAdapter to serializerAdapter

* Runtime change: CollectionFormat moved

* Runtime changes: Use RestClient for generic clients

* Fix paging test

* Get rid of gradle and use maven

* Use pluggable response builder

* Finish up response builder factory

* [Azure/autorest-clientruntime-for-java#119] rename ServiceCall#create()

* [fixes Azure/autorest-clientruntime-for-java#125] remove all references to old callback classes

* Revert to previous next method annotation

* Support fragmented paging

* [#1426] Tests for fragment paging

* Update scripts and docs to use maven

* Support custom logging interceptor

* Remove composite swagger modeler fix

* Remove android footprint

* Reduce complexity on exception construction

* Consistent naming for getters and setters

* Remove duplicate RestClient imports

* Fix maven test runner in gulpfile

* Fix Enum name generation

* Add JsonProperty everywhere

* Regenerate samples

* Fixed AutoRest.Python.Azure.Tests.AcceptanceTests.SampleTestForGeneratingPython (#1759)

* Update AcceptanceTests.cs

* Update SwaggerSpecHelper.cs

* Remove Azure extensions configuration from __init__ in Python (#1745)

* Remove nextLink check in Python

* Remove Azure extensions from __init__ in Python

* Regenerate Python tests

* [Azure.Python] Update setup.py dependency on msrestazure

* [Azure.Python] Regenerate Azure Python tests

* Xml support (#1744)

* Swagger schema adjustment

* wip -1

* removed old xml gen

* xml model

* tests

* real path

* additional test

* test server

* wip 5

* xml wip

* missing files

* fixes

* Tweaked enum serialization

* generic deserialization

* isWrapped serialization support

* rfc date

* niklas

* new properties

* fix response header creation

* refactor and remove custom (de)serialization

* naming

* unnecessary whitespace change

* fixed templates to be non-xml sensitive

* regen

* regen

* fixed nullable dictionary xml deserialization and regened petstoreV2

* cleanup

* xml serialization fix

* fixed testcase

* another special case for list serialization

* Literate File Formats (#1743)

* Drafting Literate docs

* test data format

* updated doc

* more

* literate Swagger

* added literate-metadata

* added literate-metadata

* updated docs

* Got rid of ReadOnly validation (#1749)

* Fixed and improved UniqueResourcePaths linter rule (#1768)

* fixed UniqueResourcePaths

* addressed feedback

* cleaner code gen (less unnecessary code) (#1771)

* Make S.X.X a build-time dependency.

* Fix #1738 (#1772)

* cleaner code gen (less unnecessary code)

* add disambiguation

* fixed test

* regex valitation for dictionary values (#1773)

* Code changes to generate resources/subresources (#1769)

Code changes to generate resources/subresources in ruby based on the standard definitions defined in MSRestAzure

* Removing sanitization for redable output paths

* Eliminate // in the Path output

* Update SwaggerModelerCompareTests

* Fix generation of ARM markdown help files. (#1765)

Include API specific name property instead of the generic one (it provides
better doc text than the generic "name of the resource" one).
Merge AllOf/Properties into a flat list so that AllOf is included.
Removed EnsureUniqueFileName as it's not needed.
Fix unnecessary nesting output directories.
Fixed a silly bug in InlineLink missing a '#' character.

* Adding new property for readable log output

* Linter Validation rules (#1751)

* Adding Validation Rule to check the format for API Version

* Fix the regular expression

* Added validation to check the HTTP Verb

* Added validation to check the properties of resources and their read only preoperties

* Added validation is resource validation must have x-ms-azure-resource extension

* Fixed the condition

* Added Validation to check if the delete operation have empty body

* Added validation to validate x-ms-client-name field

* Fix the signature

* Added validation to check the response of put/get/patch operations

* Fixed the signature

* Added validation to discourage usage of Guid

* Added code to validate if operations API has been implemented

* Added code to validate tracked resources

* Added code to validate properties of tracked resources

* Additional changes

* Fix the Build Issue

* Response to PR comments

* Added Test cases

* Added more test cases

* Fixing test cases

* Removed circular dependency test case

* Cache version strings after first generation. (#1784)

* Cache version strings after first generation.

Also, rewrite CodeNamerGo method to be more readable and have fewer
allocations.

* Responding to PR comments.

* Adding missing package imports to template.

* Reversing change that made two fields static.

* Update readme to reflect requirements of repo build (#1719)

* Update ms_rest and ms_rest_azure version for tests

* Update minimum required runtime version message

* Fix bug in parameter grouping in some languages (#1775)

- The bug was that parameter group "transform" has to happen after the groups are
    processed. In CSharpAzure and CSharpFluent, it was happening too early and so the
    language specific capitalization rules wern't being applied.

* Fix ruby rspec test to deserialize post long-running operation

* fix cross referencing models in relative swagger specs (#1805)

* Fixed constant parameter (#1796)

* Make Python tests less nervous about Exception string content (#1781)

* [Go] Added x-ms-parametrized-host support (#1803)

* wip

* fix dat razor

* [Go] Adding support fo x-ms-parametrized-host

* Fixed bug 1763 and added unit tests (#1800)

* Fixed bug 1763 and added unit tests

* Fixed failing test

* Fixed comments

* Checking files for proper ctor text

* Addressed comment

* Fixing format bug preventing Go gen. (#1795)

* [Linter] Adding rule to warn about boolean type properties (#1783)

* Adding rule to warn about boolean type properties

* Adding test case for rule

* [ReadMe] Change commands to fixed width font (#1774)

* Hotfix after Java runtime beta5 release

* java tests

* regen

* merged

README.md

@@ -35,16 +35,16 @@ AutoRest can be run on macOS and *nix using [Mono](http://www.mono-project.com/d
 Or [Docker](https://docs.docker.com/engine/installation):
 
   # Download Swagger.json example
-  curl -O https://raw.githubusercontent.com/Azure/autorest/master/Samples/petstore/petstore.json
+  `curl -O https://raw.githubusercontent.com/Azure/autorest/master/Samples/petstore/petstore.json`
 
   # Download latest AutoRest Docker image
-  docker pull azuresdk/autorest:latest
+  `docker pull azuresdk/autorest:latest`
 
   # Run AutoRest using Docker, mounting the current folder (pwd) into /home inside the container
-  docker run -it --rm -v $(pwd):/home azuresdk/autorest:latest autorest \
+  `docker run -it --rm -v $(pwd):/home azuresdk/autorest:latest autorest \
     -CodeGenerator CSharp \
     -Input /home/petstore.json \
-    -OutputDirectory /home/CSharp_PetStore -Namespace PetStore
+    -OutputDirectory /home/CSharp_PetStore -Namespace PetStore`
 
 ## Building AutoRest
 AutoRest is developed primarily in C# but generates code for multiple languages. See [this link](docs/developer/guide/building-code.md) to build and test AutoRest.

Samples/petstore/Go/client.go

@@ -18,30 +18,30 @@ const (
     // APIVersion is the version of the Petstore
     APIVersion = "1.0.0"
 
-    // DefaultBaseURI is the default URI used for the service Petstore
-    DefaultBaseURI = "http://petstore.swagger.io/v2"
+        // DefaultBaseURI is the default URI used for the service Petstore
+        DefaultBaseURI = "http://petstore.swagger.io/v2"
 )
 
 // ManagementClient is the base client for Petstore.
 type ManagementClient struct {
     autorest.Client
-    BaseURI string
+        BaseURI string
     APIVersion string
 }
 
 // New creates an instance of the ManagementClient client.
 func New()ManagementClient {
-    return NewWithBaseURI(DefaultBaseURI, )
+        return NewWithBaseURI(DefaultBaseURI, )
 }
 
-// NewWithBaseURI creates an instance of the ManagementClient client.
-func NewWithBaseURI(baseURI string, ) ManagementClient {
-   return ManagementClient{
-        Client: autorest.NewClientWithUserAgent(UserAgent()),
-        BaseURI: baseURI,
-        APIVersion: APIVersion,
+    // NewWithBaseURI creates an instance of the ManagementClient client.
+    func NewWithBaseURI(baseURI string, ) ManagementClient {
+        return ManagementClient{
+            Client: autorest.NewClientWithUserAgent(UserAgent()),
+            BaseURI: baseURI,
+            APIVersion: APIVersion,
+        }
     }
-}
 
     // AddPet adds a new pet to the store. You may receive an HTTP invalid input if
     // your pet is invalid.

Samples/petstore/Go/version.go

@@ -2,25 +2,41 @@ package petstore
 
 
 import (
+    "bytes"
     "fmt"
+    "strings"
 )
 
 const (
     major = "0"
     minor = "0"
     patch = "0"
-    // Always begin a "tag" with a dash (as per http://semver.org)
-    tag   = "-beta"
-    semVerFormat = "%s.%s.%s%s"
+    tag   = ""
     userAgentFormat = "Azure-SDK-For-Go/%s arm-%s/%s"
 )
+// cached results of UserAgent and Version to prevent repeated operations.
+var (
+    userAgent string
+    version string
+)
 
 // UserAgent returns the UserAgent string to use when sending http.Requests.
 func UserAgent() string {
-    return fmt.Sprintf(userAgentFormat, Version(), "petstore", "1.0.0")
+    if userAgent == "" {
+        userAgent = fmt.Sprintf(userAgentFormat, Version(), "petstore", "1.0.0")
+    }
+    return userAgent
 }
 
 // Version returns the semantic version (see http://semver.org) of the client.
 func Version() string {
-    return fmt.Sprintf(semVerFormat, major, minor, patch, tag)
+    if version == "" {
+        versionBuilder := bytes.NewBufferString(fmt.Sprintf("%s.%s.%s", major, minor, patch))
+        if tag != "" {
+            versionBuilder.WriteRune('-')
+            versionBuilder.WriteString(strings.TrimPrefix(tag, "-"))
+        }
+        version = string(versionBuilder.Bytes())
+    }
+    return version
 }

attic/gulpfile.js

@@ -140,6 +140,7 @@ var goMappings = {
   'url':['../../dev/TestServer/swagger/url.json','urlgroup'],
   'validation':['../../dev/TestServer/swagger/validation.json', 'validationgroup'],
   'paging':['../../dev/TestServer/swagger/paging.json', 'paginggroup'],
+  'more-custom-base-uri':['../../dev/TestServer/swagger/custom-baseUrl-more-options.json', 'morecustombaseurigroup'],
   'azurereport':['../../dev/TestServer/swagger/azure-report.json', 'azurereport']
 };
 

docs/developer/guide/building-code.md

@@ -13,7 +13,7 @@ Expected time around 100 minutes to install.
 - Windows 10 Anniversary - (has PackageManagement, developer mode and supports WSL.)
 - JDK 8
 - Android SDK
-- NodeJS
+- NodeJS (LTS Version: v6.9.4 or higher)
 - Gulp
 - Ruby 2.3
 - Ruby Devkit

gulpfile.iced

@@ -57,33 +57,39 @@ autorest = (args) ->
 ############################################### 
 task 'test', "runs all tests", ->
   run 'test-cs',
+      'test-go'
+      'test-java'
       'test-node'
-      'test-ruby'
       'test-python'
-      'test-go'
+      'test-ruby'
 
-############################################### 
+###############################################
+task 'test-go', 'runs Go tests', -> # FAILS, but also on master branch...
+  exec "glide up",               { cwd: './src/generator/AutoRest.Go.Tests/src/tests' }
+  exec "go fmt ./generated/...", { cwd: './src/generator/AutoRest.Go.Tests/src/tests' }
+  exec "go run ./runner.go",     { cwd: './src/generator/AutoRest.Go.Tests/src/tests' }
+
+###############################################
+task 'test-java', 'runs Java tests', ->
+  exec "mvn test", { cwd: './src/generator/AutoRest.Java.Tests/' }
+  exec "mvn test", { cwd: './src/generator/AutoRest.Java.Azure.Tests/' }
+
+###############################################
 task 'test-node', 'runs NodeJS tests', ->
-  exec "npm test", { cwd: './src/generator/AutoRest.NodeJS.Tests/' }
+  #exec "npm test", { cwd: './src/generator/AutoRest.NodeJS.Tests/' }
   exec "npm test", { cwd: './src/generator/AutoRest.NodeJS.Azure.Tests/' }
 
-############################################### 
+###############################################
 task 'test-python', 'runs Python tests', ->
   exec "tox", { cwd: './src/generator/AutoRest.Python.Tests/' }
   exec "tox", { cwd: './src/generator/AutoRest.Python.Azure.Tests/' }
 
-############################################### 
+###############################################
 task 'test-ruby', 'runs Ruby tests', ->
   exec "ruby RspecTests/tests_runner.rb", { cwd: './src/generator/AutoRest.Ruby.Tests/' }
   exec "ruby RspecTests/tests_runner.rb", { cwd: './src/generator/AutoRest.Ruby.Azure.Tests/' }
 
-############################################### 
-task 'test-go', 'runs Go tests', ['regenerate-go'], -> # FAILS, but also on master branch...
-  exec "glide up",               { cwd: './src/generator/AutoRest.Go.Tests/src/tests' }
-  exec "go fmt ./generated/...", { cwd: './src/generator/AutoRest.Go.Tests/src/tests' }
-  exec "go run ./runner.go",     { cwd: './src/generator/AutoRest.Go.Tests/src/tests' }
-
-############################################### 
+###############################################
 # LEGACY 
 # Instead: have bunch of configuration files sitting in a well-known spot, discover them, feed them to AutoRest, done.
 

pom.xml

@@ -70,12 +70,12 @@
       <dependency>
         <groupId>com.microsoft.rest</groupId>
         <artifactId>client-runtime</artifactId>
-        <version>1.0.0-beta5-SNAPSHOT</version>
+        <version>1.0.0-beta6-SNAPSHOT</version>
       </dependency>
       <dependency>
         <groupId>com.microsoft.azure</groupId>
         <artifactId>azure-client-runtime</artifactId>
-        <version>1.0.0-beta5-SNAPSHOT</version>
+        <version>1.0.0-beta6-SNAPSHOT</version>
       </dependency>
       <dependency>
         <groupId>commons-codec</groupId>

src/core/AutoRest.Core/Properties/Resources.resx

@@ -323,4 +323,7 @@
   <data name="InvalidMutabilityValueForReadOnly" xml:space="preserve">
     <value>When property is modeled as "readOnly": true then x-ms-mutability extension can only have "read" value. When property is modeled as "readOnly": false then applying x-ms-mutability extension with only "read" value is not allowed. Extension contains invalid values: '{0}'.</value>
   </data>
+  <data name="BooleanPropertyNotRecommended" xml:space="preserve">
+    <value>Booleans are not descriptive and make them hard to use. Instead use string enums with allowed set of values defined: '{0}'.</value>
+  </data>
 </root>

src/core/AutoRest/Simplify/CSharpSimplifier.cs

@@ -16,7 +16,6 @@
 using Newtonsoft.Json;
 using AutoRest.Core.Utilities;
 using System.Net;
-using System.Reflection;
 
 namespace AutoRest.Simplify
 {