Stats

  • Locked Locked
  • Replies 10
  • Subscribers 143
  • Views 15759
  • Members are here 0
This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

How to speed up reading a file ?

Charley Chen

Hi All,

 I read a file which has 1386213 line  or more , only read each line  , it spend  7 minutes  and above.

How can it speed up ?

 

procedure( QQ(file)
   prog( ()
      inPort=infile(file)
           while( gets(inLine inPort)

               ........
           ) ;if
      ) ;while
       inPort=nil
  ) ;prog
) ;procedure

 

Thank you,

Charley

Parents
  • Andrew,

    I think the problem is not exactlly in while (gets(nextLine inPort) ..

    I compare two case , one is   qq = parseString(nextLine “\n”)  ;; once

                                   two is   qq = parseString(nextLine “\n”) ; once

                                                qq = parseString(car(qq) " ") ; twice

    The problem is the more "parseString" you use the more time it needs

    But I need to do twice parseString to (1) remove \n (2) convert to list  to get date

    Is ther any command to to that ?

    Thank you,

    Charley

     ;Write filegetCurrentTime()outPort=outfile(“test”)for(I 0 100000000   fprintf(outPort “%s%d\n” “TEST” i));forclose(outPort)getCurrentTime()  ;Read filegetCurrentTime()inPort=infile(“test”)while(gets(nextLine inPort)

               qq = parseString(nextLine “\n”)
               qq = parseString(car(qq) " ");inPort = nilgetCurrentTime()
Reply
  • Andrew,

    I think the problem is not exactlly in while (gets(nextLine inPort) ..

    I compare two case , one is   qq = parseString(nextLine “\n”)  ;; once

                                   two is   qq = parseString(nextLine “\n”) ; once

                                                qq = parseString(car(qq) " ") ; twice

    The problem is the more "parseString" you use the more time it needs

    But I need to do twice parseString to (1) remove \n (2) convert to list  to get date

    Is ther any command to to that ?

    Thank you,

    Charley

     ;Write filegetCurrentTime()outPort=outfile(“test”)for(I 0 100000000   fprintf(outPort “%s%d\n” “TEST” i));forclose(outPort)getCurrentTime()  ;Read filegetCurrentTime()inPort=infile(“test”)while(gets(nextLine inPort)

               qq = parseString(nextLine “\n”)
               qq = parseString(car(qq) " ");inPort = nilgetCurrentTime()
Children
No Data

Community Guidelines

The Cadence Design Communities support Cadence users and technologists interacting to exchange ideas, news, technical information, and best practices to solve problems and get the most from Cadence technology. The community is open to everyone, and to provide the most value, we require participants to follow our Community Guidelines that facilitate a quality exchange of ideas and information. By accessing, contributing, using or downloading any materials from the site, you agree to be bound by the full Community Guidelines.