How do I read comma separated CVS file under UNIX / Linux / BSD / Mac OS X bash script? My sample file is as follows:
FirstName LastName,DOB,SSN,Telephone,Status
You can use while shell loop to read comma-separated cvs file. IFS variable will set cvs separated to , (comma). read command will read each line and store data into each field.
#!/bin/bash INPUT=data.cvs OLDIFS=$IFS IFS=, [ ! -f $INPUT ] && { echo "$INPUT file not found"; exit 99; } while read flname dob ssn tel status do echo "Name : $flname" echo "DOB : $dob" echo "SSN : $ssn" echo "Telephone : $tel" echo "Status : $status" done < $INPUT IFS=$OLDIFS |
14 comment
script that worked for me
#!/bin/bash INPUT=./Zabbix_template_item.csv OLDIFS=$IFS IFS=";" [ ! -f $INPUT ] &while read Host Group itItemType itKey itValueType itDescription itDelay itHistory itTrends itDataType itUnits itMultiplier itDelta itFormula itParams itSnmpCom itSnmpOid itApplication do echo "Host : $Host" echo "Group : $Group" echo "itItemType : $itItemType" echo "itKey : $itKey" echo "itValueType : $itValueType" echo "itDescription : $itDescription" echo "itDelay : $itDelay" echo "itHistory : $itHistory" echo "itTrends : $itTrends" echo "itDataType : $itDataType" echo "itUnits : $itUnits" echo "itMultiplier : $itMultiplier" echo "itDelta : $itDelta" echo "itFormula : $itFormula" echo "itParams : $itParams" echo "itSnmpCom : $itSnmpCom" echo "itSnmpOid : $itSnmpOid" echo "itApplication : $itApplication" done < $INPUT IFS=$OLDIFSHow to skip commented/blank lines in the CSV file?
i have used the same code to read my csv file but i cant read the last row of my csv file using while loop. please help.
I’m having the same issue. The last row of my csv isn’t being read. Did you find a solution roop?
I am having the same issue. will try to figure out ans post it.
you can get the last line when you access the variables again outside the loop. using the example discussed in the post:
—————————–
while read flname dob ssn tel status
…..
done < $INPUT
echo $flname # <—– this will be the last line of the CSV
I have two Csv files one is for daily report purposed and another is for daily data purposed.
masterreport.csv file format is
CODE,1-May-12,2-May-12,3-May-12,4-May-12,5-May-12,
205,0,0,0,0,0,
23070,0,0,0,0,0,
Interface error response CRBT fail,0,1,0,0,0,
C2S exception,0,1,2,0,2,
Interface Customer Recharge Not Allowed For Receiver,2240,2078,2050,2007,2363,
—–Many more up to 45 Rows and 32 column are there
and every day we have to update the corresponding date part from below mention file.
dailyreport.csv
C2S ERROR EXCEPTION TAKING TIME TILL VALIDATION , 624
CHNL_ERROR_SNDR_AMT_NOTBETWEEN_MINMAX , 56
Card Group Slab Suspended , 7096
like how many error’s are coming on that day we have to update the main report , which are not match daily report we put the value 0 on main report.
i didn’t found any logic how to do this , can any body help this
15 years working with csv files in bash and I didn’t know this method!
Thanks a lot.
wow it’s really helpful.
Thx.
This way to get fields into a CSV is easy to use.
Exactly what i needed.
Thanx
This was exactly what I needed! I’m using it to import account data from a Zimbra server backup.
IE account names are stored in the CSV and the script runs the import command with the $flname variable in the appropriate spots.
I do have a question, How does it know to hit the next line and not just read the first line every time? My assumption is that is what the $IFS & $OLDIFS variables do. But I’m not sure.
This method is only for regular simplest version of CSV. very often fields are in quotation marks and it contains comma. In that situation for row
content1,”content,number2″,content3
read c1 c2 c3 assign
c1=’content1′
c2='”content”
c3=’number2″
then this method is not as universal as it should be.
last problem, very often last row in csv file is not ended with new line. in that situation read has some problem with fetching last row.
summarizing. this is the simplest way for reading the simplest cvs formatting.
Awk solution on github: https://github.com/benalt613/csv