count_fields() off-by-one

[npjc]

count_fields("1\t2\n", tokenizer_tsv())
#> [1] 1

I would have expected 2 fields given:

str(read_tsv("1\t2\n", col_names = F))
#> Classes ‘tbl_df’, ‘tbl’ and 'data.frame':    1 obs. of  2 variables:
#> $ X1: int 1
#> $ X2: int 2

---

sessionInfo()
R version 3.2.0 (2015-04-16)
Platform: x86_64-apple-darwin13.4.0 (64-bit)
Running under: OS X 10.10.3 (Yosemite)

locale:
[1] en_CA.UTF-8/en_CA.UTF-8/en_CA.UTF-8/C/en_CA.UTF-8/en_CA.UTF-8

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] readr_0.1.0.9000

loaded via a namespace (and not attached):
[1] tools_3.2.0 Rcpp_0.11.6

[hadley]

Fixed in cf37840