Vim Tips Wiki
(→‎Display or remove unwanted whitespace with a script: convention here and in the :help is to use <CR> in mappings)
(z)
Tag: Visual edit
(20 intermediate revisions by 14 users not shown)
Line 1: Line 1:
{{review}}
 
 
{{TipImported
 
{{TipImported
 
|id=878
 
|id=878
 
|previous=876
 
|previous=876
 
|next=879
 
|next=879
|created=February 18, 2005
+
|created=2005
 
|complexity=intermediate
 
|complexity=intermediate
 
|author=Bertram Scharpf
 
|author=Bertram Scharpf
Line 12: Line 11:
 
|category2=
 
|category2=
 
}}
 
}}
==Simple commands to remove unwanted whitespace==
 
In a search, <tt>\s</tt> finds whitespace (a space or a tab), and <tt>\+</tt> finds one or more occurrences.
 
   
 
== Simple commands to remove unwanted whitespace ==
Delete all trailing whitespace (at the end of each line) with:
 
 
In a search, <code>\s</code> finds whitespace (a space or a tab), and <code>\+</code> finds one or more occurrences.
  +
 
==== Delete all trailing whitespace (at the end of each line) with: ====
 
<pre>
 
<pre>
 
:%s/\s\+$//
 
:%s/\s\+$//
 
</pre>
 
</pre>
   
  +
Like with ''ed(1)'', the substitution text can be omitted if blank:
More rarely, you might want to delete whitespace at the beginning of each line:
 
 
<pre>
  +
:%s/\s\+$
 
</pre>
  +
 
More rarely, a user might want to delete (leading) whitespace at the beginning of each line:
 
<pre>
 
<pre>
:%s/^\s\+//
+
:%s/^\s\+
 
" Same thing (:le = :left = left-align given range):
 
" Same thing (:le = :left = left-align given range):
 
:%le
 
:%le
 
</pre>
 
</pre>
   
With the following mapping you can press F5 to delete all trailing whitespace. The variable <tt>_s</tt> is used to save and restore the last search pattern register (so next time you press <tt>n</tt> you will continue your last search), and <tt>:nohl</tt> is used to switch off search highlighting (so trailing spaces won't be highlighted while you are typing). The <tt>e</tt> flag is used in the substitute command so no error is shown if trailing whitespace is not found.
+
With the following mapping a user can press F5 to delete all trailing whitespace. The variable <code>_s</code> is used to save and restore the last search pattern register (so next time the user presses <code>n</code> they will continue their last search), and <code>:nohl</code> is used to switch off search highlighting (so trailing spaces will not be highlighted while the user types). The <code>e</code> flag is used in the substitute command so no error is shown if trailing whitespace is not found. Unlike before, the substitution text must be specified in order to use the required flag.
 
<pre>
 
<pre>
 
:nnoremap <silent> <F5> :let _s=@/<Bar>:%s/\s\+$//e<Bar>:let @/=_s<Bar>:nohl<CR>
 
:nnoremap <silent> <F5> :let _s=@/<Bar>:%s/\s\+$//e<Bar>:let @/=_s<Bar>:nohl<CR>
Line 35: Line 40:
   
 
==Display or remove unwanted whitespace with a script==
 
==Display or remove unwanted whitespace with a script==
Here is a more elaborate procedure that can display or remove unwanted whitespace. Here, "unwanted" means any spaces before a tab character, or any space or tab at the end of a line.
+
The following is a more elaborate procedure that can display or remove unwanted whitespace. Here, "unwanted" means any spaces before a tab character, or any space or tab at the end of a line.
   
 
<pre>
 
<pre>
 
function ShowSpaces(...)
 
function ShowSpaces(...)
let @/="\\v(\\s+$)|( +\\ze\\t)"
+
let @/='\v(\s+$)|( +\ze\t)'
 
let oldhlsearch=&hlsearch
 
let oldhlsearch=&hlsearch
 
if !a:0
 
if !a:0
Line 62: Line 67:
 
</pre>
 
</pre>
   
  +
This is a similar function which similates the manual steps for removing the whitespace.
'''Note:''' Some comments (and/or pointers) explaining what the respective functions' individual lines actually do would be very helpful.
 
 
An alternative function simulating manual steps:
 
 
<pre>
 
<pre>
 
function StripTrailingWhitespace()
 
function StripTrailingWhitespace()
Line 79: Line 82:
   
 
==Automatically removing all trailing whitespace==
 
==Automatically removing all trailing whitespace==
Just put the following line in your vimrc file. Everytime you issue a <tt>:w</tt> command, Vim will automatically remove all trailing whitespace before saving.
+
One way to make sure to remove all trailing whitespace in a file is to set an <code>autocmd</code> in your .vimrc file. Every time the user issues a <code>:w</code> command, Vim will automatically remove all trailing whitespace before saving.
 
<pre>
 
<pre>
 
autocmd BufWritePre * :%s/\s\+$//e
 
autocmd BufWritePre * :%s/\s\+$//e
 
</pre>
 
</pre>
   
This is a very dangerous autocmd to have! This will *always* strip trailing whitespace from *every* file you save. Sometimes, trailing whitespace is desired, or even essential!
+
However, this is a very dangerous autocmd to have as it will always strip trailing whitespace from every file a user saves. Sometimes, trailing whitespace is desired, or even essential in a file so be careful when implementing this <code>autocmd</code>.
   
  +
One method to mitigate this issue in a .vimrc file, where trailing whitespace matters, is to change how .vimrc prepends wrapped lines. For example, add the following into the .vimrc:
For example, if in your .vimrc you have the following:
 
 
<pre>
 
<pre>
 
set wrap
 
set wrap
Line 94: Line 97:
 
</pre>
 
</pre>
   
then saving your .vimrc will make it use <tt>">&nbsp;&nbsp;\"</tt> instead of <tt>">&nbsp;&nbsp;&nbsp;"</tt> to prepend to wrapped lines!
+
Now when saving the .vimrc it will use <code>"> \"</code> instead of <code>"> "</code> to prepend wrapped lines.
   
  +
A user can also specify a particular filetype in an <code>autocmd</code> so that only that filetype will be changed when saving. The following only changes files with the extension .pl:
----
 
Remember you can also specify filetype
 
 
<pre>
 
<pre>
 
autocmd BufWritePre *.pl :%s/\s\+$//e
 
autocmd BufWritePre *.pl :%s/\s\+$//e
 
</pre>
 
</pre>
   
  +
Additionally, a FileType autocommand can be used to restrict the <code>autocmd</code> to certain file types only.
or how about having this operate when you Enter the file:
 
 
<pre>
 
<pre>
autocmd BufEnter *.php :%s/\s\+$//e
+
autocmd FileType c,cpp,java,php autocmd BufWritePre <buffer> :%s/\s\+$//e
 
</pre>
 
</pre>
   
  +
==See also==
And let's get rid of those pesky ^M at the same time
 
  +
*{{help|:autocmd}} - Additional information on <code>autocmd</code>
<pre>
 
autocmd BufEnter *.php :%s/[ \t\r]\+$//e
 
</pre>
 
 
With a ":call" instead of ":%s" (keep last used search/replace) and using FileType:
 
<pre>
 
autocmd FileType c,cpp,java,php autocmd BufWritePre <buffer> :call setline(1,map(getline(1,"$"),'substitute(v:val,"\\s\\+$","","")'))
 
</pre>
 
   
  +
==Related scripts==
{{help|:autocmd}}
 
  +
* The {{script|id=3967|text=DeleteTrailingWhitespace}} plugin offers a eponymous command, and can remove trailing whitespace automatically when the buffer is written.
  +
* The {{script|id=3201|text=trailing-whitespace}} plugin defines :FixWhitespace.
  +
* The {{script|id=3735|text=bad-whitespace}} plugin defines :EraseBadWhitespace.
  +
* The {{script|id=3938|text=Trailer Trash}} plugin defines :Trim.
   
 
==Comments==
 
==Comments==
Line 139: Line 138:
   
 
----
 
----
My preferred setting of list and listchars:
+
My preferred setting of list and listchars so that I can see my whitespace instead of removing it:
 
<pre>
 
<pre>
 
set list listchars=tab:»·,trail:·
 
set list listchars=tab:»·,trail:·
Line 155: Line 154:
 
·⁖⁖⁖⁖⁖⁖⁖text after tab with four spaces after it¶¶¶¶
 
·⁖⁖⁖⁖⁖⁖⁖text after tab with four spaces after it¶¶¶¶
 
----
 
----
There is one occasion where I want to keep my trailing space. But even in those documents, I want to keep it in only one place, and not every occurrence.
+
There is one occasion where I want to keep my trailing space. But even in those documents, I want to keep it in only in one place, and not every occurrence.
   
 
Here is my substitution pattern:
 
Here is my substitution pattern:
Line 180: Line 179:
   
 
----
 
----
  +
I modified one of the above scripts to let the user know if whitespace was found
 
<pre>
  +
" automatically remove trailing whitespace before write
  +
function! StripTrailingWhitespace()
  +
normal mZ
  +
%s/\s\+$//e
  +
if line("'Z") != line(".")
  +
echo "Stripped whitespace\n"
  +
endif
  +
normal `Z
  +
endfunction
  +
autocmd BufWritePre *.cpp,*.hpp,*.i :call StripTrailingWhitespace()
 
</pre>
  +
 
----
  +
I didn't get the <code>*</code> match to work so I used <code>*.*</code> instead:
  +
<pre>
 
autocmd BufWritePre *.* :%s/\s\+$//e
  +
</pre>
  +
  +
----
  +
Marks are unnecessary, at least in Vim 7. (Yes, that *.{cpp,h,c,etc} syntax is valid. Much better than *.cpp,*.h,*.c,*.etc IMHO.)
  +
  +
<pre>
  +
autocmd BufWritePre *.{cpp,h,c,etc} call StripTrailingWhite()
  +
  +
function! StripTrailingWhite()
  +
let l:winview = winsaveview()
  +
silent! %s/\s\+$//
  +
call winrestview(l:winview)
  +
endfunction
  +
</pre>
  +
----
  +
Actually because %s seems like is forcing a redraw line by line (is a guess), I get faster result by entering EX mode first:
  +
<pre>
  +
autocmd BufWritePre <Esc>Q :call StripTailingWhite()<CR>:visual<CR>
  +
</pre>
  +
This was a guess that worked but my limited knowledge can't answer why
  +
----
  +
  +
I like the one above that prints a message. In that case I think the mark is needed. However, there is a small bug in the implementation that fails to print the message if the current line has trailing whitespace and is the last line or only line in the file that does. Checking also for change in the number of chars in the current line fixes it.
  +
  +
<pre>
  +
function! StripTrailingWhitespace()
  +
normal mZ
  +
let l:chars = col("$")
  +
%s/\s\+$//e
  +
if (line("'Z") != line(".")) || (l:chars != col("$"))
  +
echo "Trailing whitespace stripped\n"
  +
endif
  +
normal `Z
  +
endfunction
  +
  +
autocmd BufWritePre * :call StripTrailingWhitespace()
  +
</pre>

Revision as of 09:12, 2 January 2015

Tip 878 Printable Monobook Previous Next

created 2005 · complexity intermediate · author Bertram Scharpf · version 6.0


Simple commands to remove unwanted whitespace

In a search, \s finds whitespace (a space or a tab), and \+ finds one or more occurrences.

Delete all trailing whitespace (at the end of each line) with:

:%s/\s\+$//

Like with ed(1), the substitution text can be omitted if blank:

:%s/\s\+$

More rarely, a user might want to delete (leading) whitespace at the beginning of each line:

:%s/^\s\+
" Same thing (:le = :left = left-align given range):
:%le

With the following mapping a user can press F5 to delete all trailing whitespace. The variable _s is used to save and restore the last search pattern register (so next time the user presses n they will continue their last search), and :nohl is used to switch off search highlighting (so trailing spaces will not be highlighted while the user types). The e flag is used in the substitute command so no error is shown if trailing whitespace is not found. Unlike before, the substitution text must be specified in order to use the required flag.

:nnoremap <silent> <F5> :let _s=@/<Bar>:%s/\s\+$//e<Bar>:let @/=_s<Bar>:nohl<CR>

See Highlighting whitespaces at end of line to display, rather than delete, unwanted whitespace.

Display or remove unwanted whitespace with a script

The following is a more elaborate procedure that can display or remove unwanted whitespace. Here, "unwanted" means any spaces before a tab character, or any space or tab at the end of a line.

function ShowSpaces(...)
  let @/='\v(\s+$)|( +\ze\t)'
  let oldhlsearch=&hlsearch
  if !a:0
    let &hlsearch=!&hlsearch
  else
    let &hlsearch=a:1
  end
  return oldhlsearch
endfunction

function TrimSpaces() range
  let oldhlsearch=ShowSpaces(1)
  execute a:firstline.",".a:lastline."substitute ///gec"
  let &hlsearch=oldhlsearch
endfunction

command -bar -nargs=? ShowSpaces call ShowSpaces(<args>)
command -bar -nargs=0 -range=% TrimSpaces <line1>,<line2>call TrimSpaces()
nnoremap <F12>     :ShowSpaces 1<CR>
nnoremap <S-F12>   m`:TrimSpaces<CR>``
vnoremap <S-F12>   :TrimSpaces<CR>

This is a similar function which similates the manual steps for removing the whitespace.

function StripTrailingWhitespace()
  if !&binary && &filetype != 'diff'
    normal mz
    normal Hmy
    %s/\s\+$//e
    normal 'yz<CR>
    normal `z
  endif
endfunction

However, this has minor side-effects, such as influencing undo history and sometimes changing scroll position.

Automatically removing all trailing whitespace

One way to make sure to remove all trailing whitespace in a file is to set an autocmd in your .vimrc file. Every time the user issues a :w command, Vim will automatically remove all trailing whitespace before saving.

autocmd BufWritePre * :%s/\s\+$//e

However, this is a very dangerous autocmd to have as it will always strip trailing whitespace from every file a user saves. Sometimes, trailing whitespace is desired, or even essential in a file so be careful when implementing this autocmd.

One method to mitigate this issue in a .vimrc file, where trailing whitespace matters, is to change how .vimrc prepends wrapped lines. For example, add the following into the .vimrc:

set wrap
set linebreak
" note trailing space at end of next line
set showbreak=>\ \ \

Now when saving the .vimrc it will use "> \" instead of "> " to prepend wrapped lines.

A user can also specify a particular filetype in an autocmd so that only that filetype will be changed when saving. The following only changes files with the extension .pl:

autocmd BufWritePre *.pl :%s/\s\+$//e

Additionally, a FileType autocommand can be used to restrict the autocmd to certain file types only.

autocmd FileType c,cpp,java,php autocmd BufWritePre <buffer> :%s/\s\+$//e

See also

Related scripts

Comments

Here's what I use in my .vimrc:

" Removes trailing spaces
function TrimWhiteSpace()
  %s/\s*$//
  ''
:endfunction

set list listchars=trail:.,extends:>
autocmd FileWritePre * :call TrimWhiteSpace()
autocmd FileAppendPre * :call TrimWhiteSpace()
autocmd FilterWritePre * :call TrimWhiteSpace()
autocmd BufWritePre * :call TrimWhiteSpace()

map <F2> :call TrimWhiteSpace()<CR>
map! <F2> :call TrimWhiteSpace()<CR>

My preferred setting of list and listchars so that I can see my whitespace instead of removing it:

set list listchars=tab:»·,trail:·

This gives:
»·······text after tab with four spaces after it····

Or try

set list lcs=tab:·⁖,trail:¶

This gives:
·⁖⁖⁖⁖⁖⁖⁖text after tab with four spaces after it¶¶¶¶


There is one occasion where I want to keep my trailing space. But even in those documents, I want to keep it in only in one place, and not every occurrence.

Here is my substitution pattern:

s/\(^--\)\@<!\s*$//

This will eliminate all trailing whitespaces except for the one in an email signature marker (-- ). See wikipedia:Signature block.

In the function in the tip, this expands to:

execute a:firstline.",".a:lastline."substitute /\\(^--\\)\\@<!\\s*$//ge"

Also, I've found the autocmds to work better like this:

autocmd FileWritePre * :TrimSpaces
autocmd FileAppendPre * :TrimSpaces
autocmd FilterWritePre * :TrimSpaces
autocmd BufWritePre * :TrimSpaces

(taking advantage of the default range defined in Betram's command definition)


I modified one of the above scripts to let the user know if whitespace was found

" automatically remove trailing whitespace before write
function! StripTrailingWhitespace()
  normal mZ
  %s/\s\+$//e
  if line("'Z") != line(".")
    echo "Stripped whitespace\n"
  endif
  normal `Z
endfunction
autocmd BufWritePre *.cpp,*.hpp,*.i :call StripTrailingWhitespace()

I didn't get the * match to work so I used *.* instead:

autocmd BufWritePre *.* :%s/\s\+$//e

Marks are unnecessary, at least in Vim 7. (Yes, that *.{cpp,h,c,etc} syntax is valid. Much better than *.cpp,*.h,*.c,*.etc IMHO.)

autocmd BufWritePre  *.{cpp,h,c,etc}  call StripTrailingWhite()

function! StripTrailingWhite()
    let l:winview = winsaveview()
    silent! %s/\s\+$//
    call winrestview(l:winview)
endfunction

Actually because %s seems like is forcing a redraw line by line (is a guess), I get faster result by entering EX mode first:

autocmd BufWritePre <Esc>Q :call StripTailingWhite()<CR>:visual<CR>

This was a guess that worked but my limited knowledge can't answer why


I like the one above that prints a message. In that case I think the mark is needed. However, there is a small bug in the implementation that fails to print the message if the current line has trailing whitespace and is the last line or only line in the file that does. Checking also for change in the number of chars in the current line fixes it.

function! StripTrailingWhitespace()
  normal mZ
  let l:chars = col("$")
  %s/\s\+$//e
  if (line("'Z") != line(".")) || (l:chars != col("$"))
    echo "Trailing whitespace stripped\n"
  endif
  normal `Z
endfunction

autocmd BufWritePre * :call StripTrailingWhitespace()